-- Logs begin at Thu 2022-08-25 01:52:06 UTC, end at Thu 2022-08-25 03:27:13 UTC. -- Aug 25 02:58:48.363722 dv-osbrick-854281-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 25 02:58:48.374787 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 02:58:48 2022] *** Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: nodename: dv-osbrick-854281-2-ceph Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: machine: x86_64 Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: clock source: unix Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: pcre jit disabled Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: detected number of CPU cores: 4 Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: current working directory: / Aug 25 02:58:48.376849 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: detected binary path: /usr/bin/uwsgi-core Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: your processes number limit is 47680 Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: your memory page size is 4096 bytes Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: detected max file descriptor number: 2048 Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: lock engine: pthread robust mutexes Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: thunder lock: enabled Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 25 02:58:48.377507 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 02:58:48.423675 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: Python main interpreter initialized at 0x55ef107879c0 Aug 25 02:58:48.423675 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: python threads support enabled Aug 25 02:58:48.423675 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: your server socket listen backlog is limited to 100 connections Aug 25 02:58:48.423675 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: your mercy for graceful operations on workers is 90 seconds Aug 25 02:58:48.424097 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 02:58:48.424175 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: *** Operational MODE: preforking *** Aug 25 02:58:48.424402 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: *** uWSGI is running in multiple interpreter mode *** Aug 25 02:58:48.424402 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: spawned uWSGI master process (pid: 88511) Aug 25 02:58:48.424621 dv-osbrick-854281-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 25 02:58:48.427155 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: spawned uWSGI worker 1 (pid: 88521, cores: 1) Aug 25 02:58:48.427155 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: spawned uWSGI worker 2 (pid: 88522, cores: 1) Aug 25 02:58:48.427155 dv-osbrick-854281-2-ceph devstack@keystone.service[88511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 02:58:53.131788 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:58:53.131788 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: from cryptography.utils import int_from_bytes Aug 25 02:58:53.132643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:58:53.132643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: from cryptography.utils import int_from_bytes Aug 25 02:58:53.137922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:58:53.137922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: from cryptography.utils import int_from_bytes Aug 25 02:58:53.138404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:58:53.138404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: from cryptography.utils import int_from_bytes Aug 25 02:58:53.182510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:58:53.182699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:58:53.182871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] command line args: [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:58:53.183137 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:58:53.183336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ================================================================================ {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:58:53.183567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] admin_token = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.183807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] config_dir = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.184017 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.184200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] config_source = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.184409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] debug = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.184574 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.184963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.185118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.185369 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.185615 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.185845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.186029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_config_append = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.186200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.186342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:58:53.186453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_dir = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.186559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_file = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.186675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:58:53.186781 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] command line args: [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:58:53.186903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:58:53.187138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187253 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ================================================================================ {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:58:53.187367 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] admin_token = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] config_dir = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.187977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] config_source = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188332 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188444 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] debug = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188837 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.188960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189303 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189534 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189647 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.189991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.190114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_config_append = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.190114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.190352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.190970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_dir = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.190970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_file = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.190970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.191308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.191308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] publish_errors = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.191539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.191661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.191775 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.191919 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192036 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] standard_threads = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.192995 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193366 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193487 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] use_journal = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.193836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] use_json = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] use_stderr = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] use_syslog = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.194915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.194915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.194915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.195247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.195368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.195484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] publish_errors = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.195606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.195723 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.195852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.195970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.196086 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.196200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.196330 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.196452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.196568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.196682 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.196796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.196910 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] standard_threads = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.197036 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.197152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.197272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.197393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.197393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.197580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.197702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] use_journal = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.197819 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.197916 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] use_json = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.198029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.198145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] use_stderr = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.198145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] use_syslog = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.198373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.198495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:58:53.198611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.198726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.198841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.198962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199328 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199328 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.199795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200149 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200274 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200380 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200777 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.200976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201408 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201639 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.201984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202079 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202173 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202275 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202381 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202884 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.202989 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203112 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203226 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203341 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203463 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203676 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.203923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204389 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.204966 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205526 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205526 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205809 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.205904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.206005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.206134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.206791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.206904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207002 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207303 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.207971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208077 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208301 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208632 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208745 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208869 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.208973 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209088 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209202 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209329 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209445 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209762 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.209999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210468 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210813 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.210927 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211281 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211395 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211509 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.211998 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212364 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212725 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.212955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.213910 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214032 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214032 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.214986 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.215942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216049 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216147 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216469 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216673 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.216915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217130 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217130 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217425 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217540 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217657 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.217998 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218233 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218333 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218455 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.218938 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.external = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219766 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.219945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220062 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220310 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220545 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.password = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220661 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220776 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] auth.token = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.220891 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221133 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221249 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.221981 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222112 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222231 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222349 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222466 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.222983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223218 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223337 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223454 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.223893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224014 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224131 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224258 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.external = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224740 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224857 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.224973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225223 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225341 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225459 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.password = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] auth.token = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225826 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.225944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226060 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226189 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226653 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226653 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.226988 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227230 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227472 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227596 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.227902 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228632 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228757 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.228992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229833 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.229951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230068 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230193 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.230912 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231148 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231148 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231367 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231367 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.231846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232221 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232580 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.232883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233495 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233614 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.233996 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234231 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234611 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234728 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234846 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.234963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235329 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235679 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236146 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236481 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236599 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236843 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.236962 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.237079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.237196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.237802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.237933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238171 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238562 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.238924 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239042 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239168 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239833 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.239953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240553 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.240911 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241266 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241382 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241627 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.241980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242097 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242215 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242408 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.242996 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243121 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243358 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243591 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.243891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244364 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244725 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.244879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.245001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.245117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.245243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.245627 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.245751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.245869 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246013 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.246972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247611 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.247931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248029 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248167 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248404 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248522 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248637 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248835 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.248941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249040 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249501 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249632 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249752 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249869 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.249987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250221 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250817 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.250934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251219 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251337 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.251954 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252082 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252550 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.252874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.253022 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.253667 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.253837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.253959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.253959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254179 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254413 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] role.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254775 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] role.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.254892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255126 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255252 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255370 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255487 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255722 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.255913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256167 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256284 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256402 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256761 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.256917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257037 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257752 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257870 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.257988 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258233 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258569 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258811 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.258929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259047 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259397 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259646 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] role.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.259900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] role.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260502 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.260980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261334 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261451 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261819 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.261935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262531 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262648 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.262998 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263125 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263125 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263708 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.263961 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264443 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264562 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264679 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.264913 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265156 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265156 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265448 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265688 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265805 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.265993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266231 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266231 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266452 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266696 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266824 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.266954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267308 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267308 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.connection = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267773 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.267908 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268144 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268380 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268498 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268646 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268767 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.268891 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269372 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269491 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269611 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269856 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.269973 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270090 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270687 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270848 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.270968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271211 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271567 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271684 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.271802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.connection = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.272241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.273183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.274132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.274132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.274132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:58:53.274132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:58:53.298181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.298416 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.298625 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.299650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.300435 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.300674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.307697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.309431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.336094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.336325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.337773 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.338014 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.391553 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.391783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.441414 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.441658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.442001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.442242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.508655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.508876 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509206 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509319 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509537 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.509848 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.510039 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.510261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.533568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.533748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.533917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534083 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534158 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534233 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534316 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534462 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534797 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.534931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.535027 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.546330 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.546534 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.559685 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.559835 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.559992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560509 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560715 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.560931 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.561064 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.561157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:58:53.578568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.578782 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:58:53.579108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.579195 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.579318 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:58:53.579403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:58:53.579595 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.579676 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.579861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:58:53.579960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.580138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.580223 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.580402 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.580487 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.580659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.589923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.590210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.590386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.590472 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.590666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.590751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.590935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.591216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.597792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.598314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.600728 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.601019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.601204 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.601288 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.601490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.601587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.601776 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.601862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602144 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602345 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602689 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.602962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.603156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.603239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.603424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.603506 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.603697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.603992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.626945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.627393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.629031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.629314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.629429 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.629719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.633894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.634184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.634269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.634526 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.634622 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.636523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.641211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.641504 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.642992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.643241 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.645628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.645930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.646228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.647264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.647567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.647934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.648157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.648277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.648453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.648537 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.648769 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.648858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.649069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.649152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.649344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.649436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.665790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.666065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.667060 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.667346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.670218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.671252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.673321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.673736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.674413 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.675433 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.678567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.679693 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.681697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.682884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.684803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.685104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.685392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.685790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.686018 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.686102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.686330 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.686414 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.686621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.687025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.687322 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.687609 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.702092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.702384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.702655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.702920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.703561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.703881 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.704157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.704427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.709711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.711207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.711344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.711615 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.712893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.713172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.714290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.714576 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.714858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.715153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.715434 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.715857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.716159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.716450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.716812 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.717056 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.727218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.727503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.727799 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.728111 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.728395 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.728674 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.728884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.728982 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.729176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.729466 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.729757 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.730107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.730429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.730729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.744931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.747110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.748188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.750061 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.751166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.752596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.753163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.754118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.754399 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.754593 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.754677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.756089 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.756379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.756687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.761154 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.762619 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.763182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.764692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.765505 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.765797 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.766095 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.766377 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.767674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.768044 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.768309 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.768629 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.774631 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.774924 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.775210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.776649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.776950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.777241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.781977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.783299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.783586 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.783902 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.784054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:58:53.784782 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.784973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785347 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785616 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785811 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.785973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786121 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786354 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786914 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.786995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.787175 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.787264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.787463 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.787734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.788070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.788314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:58:53.820727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ef107879c0 pid: 88522 (default app) Aug 25 02:58:53.824217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e889a-b95d-4d00-b89c-f5668ede2b6d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:53.824508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e889a-b95d-4d00-b89c-f5668ede2b6d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:53.824780 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e889a-b95d-4d00-b89c-f5668ede2b6d None None] PATH_INFO: `/v3` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:53.827060 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ef107879c0 pid: 88521 (default app) Aug 25 02:58:53.829029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Thu Aug 25 02:58:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:01.113258 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:01.113777 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:01.113777 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:01.118039 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:01.123642 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:01.124053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:01.124225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:01.199569 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: INFO dbcounter [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] Registered counter for database keystone Aug 25 02:59:01.218102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG oslo_db.sqlalchemy.engines [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:59:01.224695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writer thread running {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:59:01.402051 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG passlib.handlers.bcrypt [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88522) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 02:59:01.402405 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG passlib.handlers.bcrypt [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88522) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 02:59:01.456439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:01.458005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:01.586356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 02:59:02.105490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:02.179380 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: INFO dbcounter [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] Registered counter for database keystone Aug 25 02:59:02.200769 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG oslo_db.sqlalchemy.engines [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88521) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:59:02.207460 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writer thread running {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:59:02.324820 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d82e4-13b0-4988-b868-262ec6224e59 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:02.329016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:02.329630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:02.329907 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:02.330176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:02.338286 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:02.389899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 02:59:02.390182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcb199-c023-4719-955f-4c7adfa3b99e admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:02.399623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1324 bytes} [Thu Aug 25 02:59:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 02:59:02.405539 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:02.419880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef9ff1-842f-46c1-b2b8-978d12af30ab None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:02.424294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:02.425886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:02.426167 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:02.426436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] PATH_INFO: `/v3/projects/7ada4f5619714b09af4deed40278da87` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:02.430191 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ada4f5619714b09af4deed40278da87)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:02.479612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING keystone.common.rbac_enforcer.enforcer [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 02:59:02.479978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d2fee-8804-4126-ba43-5d5526eae2c8 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:02.484505 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 3/5] 10.222.0.78 () {56 vars in 1207 bytes} [Thu Aug 25 02:59:02 2022] GET /identity/v3/projects/7ada4f5619714b09af4deed40278da87 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:04.631096 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19693417-fb56-4a2a-90cd-69e5b402d386 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:04.631641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19693417-fb56-4a2a-90cd-69e5b402d386 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:04.631641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19693417-fb56-4a2a-90cd-69e5b402d386 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:04.635733 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 3/6] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:04.641206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:04.641632 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:04.641765 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:04.661158 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:04.662660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:04.670411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 02:59:04.993510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19693417-fb56-4a2a-90cd-69e5b402d386 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:05.006577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19693417-fb56-4a2a-90cd-69e5b402d386 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:05.010782 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32647627-a216-4c3b-8a44-303a529790c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:05.011379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647627-a216-4c3b-8a44-303a529790c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.011662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647627-a216-4c3b-8a44-303a529790c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.011969 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647627-a216-4c3b-8a44-303a529790c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.020018 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32647627-a216-4c3b-8a44-303a529790c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:05.021831 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32647627-a216-4c3b-8a44-303a529790c1 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:05.030814 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1324 bytes} [Thu Aug 25 02:59:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:59:05.036957 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:05.045933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687cf59-78cb-488e-893e-791bf4811e29 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:05.051010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786adad4-38f3-4e77-83fe-802bc5a71b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:05.051624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786adad4-38f3-4e77-83fe-802bc5a71b26 admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.051943 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786adad4-38f3-4e77-83fe-802bc5a71b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.052219 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786adad4-38f3-4e77-83fe-802bc5a71b26 admin admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.053518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786adad4-38f3-4e77-83fe-802bc5a71b26 admin admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:05.055334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786adad4-38f3-4e77-83fe-802bc5a71b26 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:05.056869 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 5/9] 10.222.0.78 () {56 vars in 1198 bytes} [Thu Aug 25 02:59:05 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:07.289613 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471d52-0f85-4cf2-bf9a-f95773a5444f None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.290157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471d52-0f85-4cf2-bf9a-f95773a5444f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.290318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471d52-0f85-4cf2-bf9a-f95773a5444f None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:07.291596 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:07.296843 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.297238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.297391 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:07.315292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:07.316536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:07.357223 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb194b2a-ecca-4aec-a853-c4c04eaf97cb None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.357612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb194b2a-ecca-4aec-a853-c4c04eaf97cb None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.357894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb194b2a-ecca-4aec-a853-c4c04eaf97cb None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:07.359186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 6/11] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:07.364536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.364828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.365113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:07.397384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 6/12] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:07.407995 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG passlib.handlers.bcrypt [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88521) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 02:59:07.408430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG passlib.handlers.bcrypt [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88521) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 02:59:07.453825 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:07.456004 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:07.554926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 7/13] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:07.728717 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:07.873825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:07.884597 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:07.955475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dafbb-77c6-4279-906a-4e85f26494ea None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:07.987340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f05dbe-6d00-4220-b232-9c7f908d55fc None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:07.990126 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:07.990289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:07.990788 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.991089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.991369 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.003492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:08.012362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:08.013503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:08.014513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 7/14] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:08.019555 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:08.028202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.029057 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.029344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.029619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.100876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.102396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.106910 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:08.126061 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b9a0-3aed-461e-9362-5d5c0958e829 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:08.159371 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.160003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.160282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.160556 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.161215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:08.161517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.162904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.174751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 8/15] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:08.180445 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:08.201320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 8/16] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:08.207187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:08.210080 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:08.292806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadbe15-86d8-4b87-ada0-0eb872721bb2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:08.333163 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.334112 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.334488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.334774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.335989 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.336547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f603f2-1756-4441-9b42-4faa035c5ac6 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:08.337462 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.339218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 9/17] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:08 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:08.344639 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:08.361593 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:08.378936 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.379846 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.380143 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.380423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.400839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.402337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:59:08.422066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:08.423950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:59:08.425732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:59:08.425732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:59:08.425732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:08.425732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 9/18] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:59:08.435918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:08.467977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851e14-33db-4846-8a08-a036aeb86582 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:08.502849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:08.505836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.506413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.506694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.506970 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.508117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.509555 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.511097 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 10/19] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:08.517640 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:08.557768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff71ddb-ed84-4210-af66-9e04197069d0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:08.602024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.602650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.602938 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.603212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.603899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:08.604257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.605686 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:08.605796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07b3a-3bfd-41f2-8881-fc38e996575a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.626565 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84540c5b-f6bc-4e4f-963c-47576f9aad65 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:08.666962 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:08.667517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:08.667803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:08.668114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:08.668868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.domain.id=default, user.id=105b635fff904668bf368a5753e43a9d) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:08.669184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:08.670668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc45c-3010-4efc-8ae0-5529733f29f5 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:08.678303 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 11/20] 10.222.0.78 () {56 vars in 1322 bytes} [Thu Aug 25 02:59:08 2022] GET /identity/v3/role_assignments?user.id=105b635fff904668bf368a5753e43a9d&scope.domain.id=default&role.id=7f519a00587a4cb38cff222d59894a29 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:08.736795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 10/21] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 02:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:11.314859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190c4a-ca9e-42be-92b4-c2a05494a08a None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.321796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190c4a-ca9e-42be-92b4-c2a05494a08a None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.322314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190c4a-ca9e-42be-92b4-c2a05494a08a None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.333888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 12/22] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:11 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:11.339301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdecf86-878b-46fb-a1e5-753e548e0e7c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.340280 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdecf86-878b-46fb-a1e5-753e548e0e7c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.340770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdecf86-878b-46fb-a1e5-753e548e0e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.364576 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-ebdecf86-878b-46fb-a1e5-753e548e0e7c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:11.366126 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-ebdecf86-878b-46fb-a1e5-753e548e0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:11.449334 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 11/23] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:11.529375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5212c5e-de8b-42da-bcb0-0ade3aed69ae None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.529997 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5212c5e-de8b-42da-bcb0-0ade3aed69ae None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.530492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5212c5e-de8b-42da-bcb0-0ade3aed69ae None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.532032 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:11.538104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94016047-6914-4aac-ac08-0ff4b2b86ebe None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.538669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94016047-6914-4aac-ac08-0ff4b2b86ebe None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.539142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94016047-6914-4aac-ac08-0ff4b2b86ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.563276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-94016047-6914-4aac-ac08-0ff4b2b86ebe None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:11.564926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-94016047-6914-4aac-ac08-0ff4b2b86ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:11.581627 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d3b1-98bc-4173-8b8d-b7b6dea23f19 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.582257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d3b1-98bc-4173-8b8d-b7b6dea23f19 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.582728 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d3b1-98bc-4173-8b8d-b7b6dea23f19 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.584282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 14/25] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:11.590234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8374f3f-6f6c-4257-b491-a75ab22ed680 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.590758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8374f3f-6f6c-4257-b491-a75ab22ed680 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.591225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8374f3f-6f6c-4257-b491-a75ab22ed680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.624785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-f8374f3f-6f6c-4257-b491-a75ab22ed680 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:11.629153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-f8374f3f-6f6c-4257-b491-a75ab22ed680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:11.663073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:11.718389 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 12/26] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:11.789344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 25 02:59:11.894969 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a321e-7a6c-498e-9967-6259b012bb86 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.895624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a321e-7a6c-498e-9967-6259b012bb86 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.896136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a321e-7a6c-498e-9967-6259b012bb86 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.897664 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 13/28] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:11.904057 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:11.904495 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:11.904917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:11.937255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:11.938521 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:11.946875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a321e-7a6c-498e-9967-6259b012bb86 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.062162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 16/29] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:12.140534 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a321e-7a6c-498e-9967-6259b012bb86 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:12.196658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:12.197660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:12.198147 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:12.198637 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:12.217356 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:12.223646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:12.225169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:12.226016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:12.226792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:12.229425 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 14/30] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:12.234713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.244430 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:12.291850 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:12.418950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc421c-6018-471d-a03d-3209b60ead12 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:12.485520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9579-ca66-4022-8fa5-d19c038d217b None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:12.490787 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:12.491408 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:12.491688 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:12.491989 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:12.492661 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:12.492963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:12.495713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:12.527347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 15/31] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:12.528536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.546670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:12.547874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:12.548383 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:12.548975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:12.561898 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:12.564268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:59:12.585012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:12.585995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:59:12.587511 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:59:12.587511 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:59:12.587511 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:12.591344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 17/32] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:12.593184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.672853 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:12.675378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:12.676917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd7063-bc63-49dc-94f5-7f06195d3f12 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:12.716954 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:12.718032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:12.718516 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:12.718931 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:12.720115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:12.722891 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:12.727873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9cde-f487-4fee-bed2-74c564d77bcb None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:12.767504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:12.769231 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:12.769880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:12.770483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:12.772750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:12.775173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:12.778309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 18/33] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:12 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:12.779897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.897570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0571-bae7-4353-918f-f498b94195a8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:12.921066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 16/34] 10.222.0.78 () {60 vars in 1131 bytes} [Thu Aug 25 02:59:12 2022] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:12.923205 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:12.924858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:12.937819 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:12.938461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:12.938748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:12.939026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:12.940518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:12.941435 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:13.058851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc45707-d4ec-43b8-8ad8-0c5012000104 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:13.103913 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 19/35] 10.222.0.78 () {60 vars in 1131 bytes} [Thu Aug 25 02:59:12 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:13.107929 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:13.108940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:13.109829 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.110315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.110794 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.111770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:13.112325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:13.114756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:13.145354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 17/36] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 02:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:13.153845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:13.179771 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:13.325979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b5cc-660e-4cbf-9cef-0e099b1a2340 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:13.332414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daf266-9e6d-4744-8527-c94057e30349 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:13.379797 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f4afd-e0b7-4e04-af2b-4b121049a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:13.380491 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f4afd-e0b7-4e04-af2b-4b121049a800 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.380771 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f4afd-e0b7-4e04-af2b-4b121049a800 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.381052 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f4afd-e0b7-4e04-af2b-4b121049a800 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.382021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70e0b-fa84-4631-820e-c97d7d9b1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:13.382835 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70e0b-fa84-4631-820e-c97d7d9b1106 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.383239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f4afd-e0b7-4e04-af2b-4b121049a800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:13.383350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70e0b-fa84-4631-820e-c97d7d9b1106 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.383699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70e0b-fa84-4631-820e-c97d7d9b1106 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.384978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f4afd-e0b7-4e04-af2b-4b121049a800 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:13.385396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b70e0b-fa84-4631-820e-c97d7d9b1106 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:13.387449 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b70e0b-fa84-4631-820e-c97d7d9b1106 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:13.387898 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 20/37] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:13.389407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7556a1f-4fc9-4fe3-8117-8ce3f2e5bc5d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.389840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7556a1f-4fc9-4fe3-8117-8ce3f2e5bc5d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.390257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7556a1f-4fc9-4fe3-8117-8ce3f2e5bc5d None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.391687 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 21/38] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:13.393463 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf6393-dc6d-44e1-953b-52284af11828 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.393753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf6393-dc6d-44e1-953b-52284af11828 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.394044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf6393-dc6d-44e1-953b-52284af11828 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.395489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 22/39] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:13.396246 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf6393-dc6d-44e1-953b-52284af11828 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:13.429763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 18/40] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 02:59:13 2022] POST /identity/v3/projects => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:13.431209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919305-94e8-47ac-a3cf-e8efaa8d926e None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.431512 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919305-94e8-47ac-a3cf-e8efaa8d926e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.431797 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919305-94e8-47ac-a3cf-e8efaa8d926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.453958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-fb919305-94e8-47ac-a3cf-e8efaa8d926e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:13.456290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-fb919305-94e8-47ac-a3cf-e8efaa8d926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:13.470356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:13.540010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf6393-dc6d-44e1-953b-52284af11828 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:13.541870 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:13.549275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 19/41] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:13.557778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.557778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.557778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.572786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:13.574303 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:13.598272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:13.599611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:13.599926 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:13.600218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] PATH_INFO: `/v3/domains/default/users/105b635fff904668bf368a5753e43a9d/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:13.603557 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=105b635fff904668bf368a5753e43a9d, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:13.605379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:13.635357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 23/42] 10.222.0.78 () {58 vars in 1361 bytes} [Thu Aug 25 02:59:13 2022] PUT /identity/v3/domains/default/users/105b635fff904668bf368a5753e43a9d/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:13.665982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 20/43] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:13.898646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:13.998636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:14.006015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5317-3021-4e22-9051-6f66cc24ea64 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:14.019700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:14.050249 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:14.050870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:14.051159 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:14.051436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:14.052150 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:14.053549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:14.069262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 24/44] 10.222.0.78 () {60 vars in 1131 bytes} [Thu Aug 25 02:59:13 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:14.119213 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45f1a9-fe44-45a5-8a62-8b4ae7a55f93 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:14.152426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:14.160029 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12f512-ab2e-4702-ba94-e062874f3825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:14.160690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12f512-ab2e-4702-ba94-e062874f3825 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:14.160977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12f512-ab2e-4702-ba94-e062874f3825 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:14.161258 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12f512-ab2e-4702-ba94-e062874f3825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:14.162458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12f512-ab2e-4702-ba94-e062874f3825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:14.163994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12f512-ab2e-4702-ba94-e062874f3825 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:14.165838 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 21/45] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:14.171586 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:14.279468 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223eff-6fe4-42cd-afd4-9ce00fb65caa None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:14.314228 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd8837-e89c-4b43-ba83-d55a8af8bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:14.314923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd8837-e89c-4b43-ba83-d55a8af8bef4 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:14.315210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd8837-e89c-4b43-ba83-d55a8af8bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:14.316041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd8837-e89c-4b43-ba83-d55a8af8bef4 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:14.316709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd8837-e89c-4b43-ba83-d55a8af8bef4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:14.318255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd8837-e89c-4b43-ba83-d55a8af8bef4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:14.347968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 25/46] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 02:59:14 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:15.839988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6243-b798-44e6-80c0-aa2f8638560a None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:15.840505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6243-b798-44e6-80c0-aa2f8638560a None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:15.840584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6243-b798-44e6-80c0-aa2f8638560a None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:15.841849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 22/47] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:15.847682 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:15.848086 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:15.848385 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:15.866465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:15.868008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:15.886488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:15.936455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 26/48] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:16.265202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6243-b798-44e6-80c0-aa2f8638560a None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:16.367443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6243-b798-44e6-80c0-aa2f8638560a None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:16.402853 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b99fe-e20f-468a-80cf-8d44ae63e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:16.403477 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b99fe-e20f-468a-80cf-8d44ae63e809 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:16.403756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b99fe-e20f-468a-80cf-8d44ae63e809 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:16.404059 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b99fe-e20f-468a-80cf-8d44ae63e809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:16.413962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b99fe-e20f-468a-80cf-8d44ae63e809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-7b0b99fe-e20f-468a-80cf-8d44ae63e809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:16.418635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:16.419608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:16.420410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 23/49] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:16.425634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:16.518272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7ec3-e484-493a-aa1c-68d7a64d261f None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:16.518525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7ec3-e484-493a-aa1c-68d7a64d261f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:16.518763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7ec3-e484-493a-aa1c-68d7a64d261f None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:16.520117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 24/50] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:16.524262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15bdde-1cf5-413e-8a25-89ada32b1335 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:16.524893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:16.525180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:16.525459 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:16.542611 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:16.543796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:16.559964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:16.560581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:16.560865 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:16.561152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:16.561817 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:16.562125 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:16.563585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:16.572371 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 27/51] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:16.577701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:16.595310 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:16.597511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:16.610923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 25/52] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:16.682504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fe7c7-0197-4353-b3b8-07a96dac0ccd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:16.716346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:16.716975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:16.717258 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:16.717534 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:16.718676 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:16.720129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:16.721725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 28/53] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:16 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:16.727313 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:16.828085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44012-c4da-4ab0-ba57-895b0d112b7a None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:16.860399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:16.861033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:16.861845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:16.862120 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:16.863224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:16.864689 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:16.866386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 26/54] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:16.872510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:16.938272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:16.968596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:16.987444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c321-414c-4549-ac0d-906b5b2d69f8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:17.000132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:17.029515 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:17.030538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:17.030929 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:17.031310 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:17.032378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.domain.id=default, user.id=105b635fff904668bf368a5753e43a9d) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:17.032767 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:17.034759 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:17.042272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 29/55] 10.222.0.78 () {56 vars in 1322 bytes} [Thu Aug 25 02:59:16 2022] GET /identity/v3/role_assignments?user.id=105b635fff904668bf368a5753e43a9d&scope.domain.id=default&role.id=7f519a00587a4cb38cff222d59894a29 => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:17.060652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1c0c0-6c62-4d9a-8b35-0aa81aff8e39 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:17.105814 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61162878-8628-4c5a-946c-59ace8937e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:17.106543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61162878-8628-4c5a-946c-59ace8937e00 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:17.106766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61162878-8628-4c5a-946c-59ace8937e00 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:17.107045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61162878-8628-4c5a-946c-59ace8937e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:17.108383 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61162878-8628-4c5a-946c-59ace8937e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:17.109904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61162878-8628-4c5a-946c-59ace8937e00 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:17.112291 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 27/56] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:17.121365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:17.233628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb86f84-380a-41ba-85d5-7e45e7d7aa3a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:17.270371 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016346f-0839-49ad-8e27-fcd9d12c1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:17.270992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016346f-0839-49ad-8e27-fcd9d12c1466 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:17.271280 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016346f-0839-49ad-8e27-fcd9d12c1466 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:17.271559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016346f-0839-49ad-8e27-fcd9d12c1466 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:17.272295 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016346f-0839-49ad-8e27-fcd9d12c1466 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:17.273746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016346f-0839-49ad-8e27-fcd9d12c1466 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:17.298055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:17.307270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 30/57] 10.222.0.78 () {60 vars in 1140 bytes} [Thu Aug 25 02:59:17 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:19.489162 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670b15-b8c9-451f-8dfa-3d78753a0c20 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:19.489670 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670b15-b8c9-451f-8dfa-3d78753a0c20 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:19.489755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670b15-b8c9-451f-8dfa-3d78753a0c20 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:19.491024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 28/58] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:19.496815 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:19.497252 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:19.497387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:19.515968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:19.519568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:19.584092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 31/59] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:19.923367 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670b15-b8c9-451f-8dfa-3d78753a0c20 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:20.025134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670b15-b8c9-451f-8dfa-3d78753a0c20 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:20.055768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:20.070364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4988dad-3e47-4e87-b6c2-0764c9c7890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:20.071048 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988dad-3e47-4e87-b6c2-0764c9c7890a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:20.071333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988dad-3e47-4e87-b6c2-0764c9c7890a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:20.071606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988dad-3e47-4e87-b6c2-0764c9c7890a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:20.072744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4988dad-3e47-4e87-b6c2-0764c9c7890a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:20.074925 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4988dad-3e47-4e87-b6c2-0764c9c7890a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:20.077327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 29/60] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:20.082978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:20.181350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d1ce7-7a6a-4c68-8ae7-21307a8682ce None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:20.208880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:20.215135 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d5b98-b097-4f38-bab6-a79e5f0ed84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:20.215736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d5b98-b097-4f38-bab6-a79e5f0ed84b None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:20.216052 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d5b98-b097-4f38-bab6-a79e5f0ed84b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:20.216330 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d5b98-b097-4f38-bab6-a79e5f0ed84b None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:20.216968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d5b98-b097-4f38-bab6-a79e5f0ed84b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:20.218446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d5b98-b097-4f38-bab6-a79e5f0ed84b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:20.248095 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 32/61] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:20 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:23.727704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94147065-cb2d-4e93-8039-e232beaa74ac None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:23.728717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94147065-cb2d-4e93-8039-e232beaa74ac None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:23.729237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94147065-cb2d-4e93-8039-e232beaa74ac None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:23.731094 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 30/62] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:23.737488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47067-7920-4c86-a110-5064caefea3e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:23.738407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47067-7920-4c86-a110-5064caefea3e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:23.738907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47067-7920-4c86-a110-5064caefea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:23.768853 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-17a47067-7920-4c86-a110-5064caefea3e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:23.770400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-17a47067-7920-4c86-a110-5064caefea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:23.788103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3e331-5194-4c29-84c7-f6b895bc8d3d None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:23.788703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3e331-5194-4c29-84c7-f6b895bc8d3d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:23.789179 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3e331-5194-4c29-84c7-f6b895bc8d3d None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:23.790703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:23.795648 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a400-5d07-4b27-8f58-aae19c07e80a None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:23.796239 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a400-5d07-4b27-8f58-aae19c07e80a None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:23.796712 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a400-5d07-4b27-8f58-aae19c07e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:23.820847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-c3e4a400-5d07-4b27-8f58-aae19c07e80a None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:23.822994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-c3e4a400-5d07-4b27-8f58-aae19c07e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:23.893630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 33/64] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:23.917918 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf05c-4879-4c09-b253-73644de1e9b0 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:23.918209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf05c-4879-4c09-b253-73644de1e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:23.918489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf05c-4879-4c09-b253-73644de1e9b0 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:23.919856 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 34/65] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:23.929254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c37d-054a-4208-be69-870480c9fba3 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:23.929541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c37d-054a-4208-be69-870480c9fba3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:23.929823 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c37d-054a-4208-be69-870480c9fba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:23.935524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 32/66] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:23.968807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-6e73c37d-054a-4208-be69-870480c9fba3 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:23.970008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-6e73c37d-054a-4208-be69-870480c9fba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:24.071363 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 35/67] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:24.306247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ead7f-c7ae-4790-97a5-cccd37b296f5 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.306604 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ead7f-c7ae-4790-97a5-cccd37b296f5 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.306798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ead7f-c7ae-4790-97a5-cccd37b296f5 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.308322 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 33/68] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:24.313558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.313850 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.314721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.330465 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ead7f-c7ae-4790-97a5-cccd37b296f5 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:24.355609 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:24.358743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:24.434031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:24.468618 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 36/69] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:24.476369 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:24.494031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ead7f-c7ae-4790-97a5-cccd37b296f5 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:24.522892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:24.537284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:24.538075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.538692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.539114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.552911 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:24.559357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:24.560276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:24.561041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 34/70] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:24.562264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:24.621846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b4a31-e97a-4ef6-91f8-f1fac86e8a5f None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:24.657526 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:24.658707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.658994 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.659272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.670712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:24.676239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:24.677096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:24.677890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 37/71] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:24.678604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:24.686742 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13360f-7294-46da-a3e4-03922b2def2a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:24.724084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dd522-7831-40ba-8124-ebc618c14212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:24.724510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dd522-7831-40ba-8124-ebc618c14212 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.724799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dd522-7831-40ba-8124-ebc618c14212 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.724956 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:24.725064 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dd522-7831-40ba-8124-ebc618c14212 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.737155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dd522-7831-40ba-8124-ebc618c14212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b08dd522-7831-40ba-8124-ebc618c14212 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:24.742052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:24.742899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:24.743675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 35/72] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 02:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:24.744355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254ec5-389f-4ec3-b023-49ff14e9ead4 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.745568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254ec5-389f-4ec3-b023-49ff14e9ead4 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.745568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254ec5-389f-4ec3-b023-49ff14e9ead4 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.746593 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 36/73] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:24.751453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254ec5-389f-4ec3-b023-49ff14e9ead4 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:24.805834 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:24.810768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bea4c-e772-4741-ab95-abaff758f576 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:24.848163 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:24.848782 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.849068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.849348 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.850021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:24.850334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:24.851759 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:24.860024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 38/74] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:24.864822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:24.866199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254ec5-389f-4ec3-b023-49ff14e9ead4 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:24.901906 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:24.902439 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.902724 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.903003 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.903681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:24.904026 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:24.905458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380f27-6ddc-45ec-940b-7cfe9a357a2a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:24.915490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:24.916306 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:24.916594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:24.916876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:24.937934 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:24.939436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:24.965658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:24.969618 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69dd03-2dbb-4271-aff1-fd322543ea96 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.004570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.005190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.005475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.005754 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.006417 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:25.006725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.007305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 38/76] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:25.008183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.012683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.021601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 39/77] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 02:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:25.022475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.049246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.127060 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933d83a-877f-4889-ae3b-bcf050cb0bd1 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.134312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ca8fd-d7dc-4c7a-8fa6-cce3b9d55e9a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.163913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.164464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.164745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.165020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.173776 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.174403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.174682 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.174955 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.175691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:25.176126 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.177551 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.179269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 40/78] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:25.184039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:25.184180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:25.185001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 39/79] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:25.185766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.216458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.290088 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434fae-cebc-41bc-b431-46fb3531a65c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.313689 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.325825 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1b358-e118-4985-a1d3-93dfc92a8985 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.335390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.336070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.336361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.336641 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.351282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.352863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.354503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 41/80] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:25.355262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.368384 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.369030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.369316 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.369845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.371297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.372741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.374454 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 40/81] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:25.375304 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.439720 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.456205 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e75a-22ef-44ef-a93c-db88bff16f77 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.479260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9c55-979c-40ab-aaac-ce2a87cf26c4 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.500128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.500994 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.501279 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.502167 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.516691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.517323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.517609 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.517886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.518553 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:25.518861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.520280 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.528468 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 41/82] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:25.529289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.555139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.571411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.572945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.632287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a24b6-613d-443a-b637-7387b8392823 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.659390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.674825 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.675678 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.676013 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.676296 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.677606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.679077 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.679777 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 42/83] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:25.680711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.680963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 42/84] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:25.681843 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:25.780275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.789889 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21462b-9884-457e-a505-d2dfe5bd55b4 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.790646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8d6c-5a07-48b9-aff7-26fa79d82f76 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:25.824761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.825379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.825660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.825793 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:25.826262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.826430 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:25.826719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:25.827001 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:25.883195 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.896699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.897545 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:25.898317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.899015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:25.989811 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:25.999928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 43/85] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:26.000775 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.013227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 43/86] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:26.014094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.101250 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.101828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3398-7af5-44c4-b390-4a3e6702b78d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.117566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25999bab-de42-499a-909a-a6c48cb71a9a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.136993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.137625 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.137925 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.138171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.139297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.140799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.142369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 44/87] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:25 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:26.143145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.154010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.154659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.154948 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.155231 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.156453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.158409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.164845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 44/88] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:26.164845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.218272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.261847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fdf01-cb3d-4a64-89b0-4d88bc252df0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.264963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900598cc-4282-486a-a07e-5764f2efdcf9 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.298908 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.299533 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.299831 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.300121 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.300778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.301934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.302218 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.302968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.303460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.303907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.305586 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.307865 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.309596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 45/89] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:26.313226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.337080 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 45/90] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:26 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:26.337872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.346522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.455561 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0baec-105f-48a8-a939-ae075e7d60c6 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.482539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221f95-9bf1-4b32-ad65-2ec653e584bb None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.500935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.501557 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.501852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.502137 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.503404 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.503702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.504966 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.513496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 46/91] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:26.513496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.543866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.544098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.544261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.545095 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.628426 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.640054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.640865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.643133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3f28-108b-4241-9991-e9e45e5358be None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.690671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.691294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.691581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.691885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.692643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=105b635fff904668bf368a5753e43a9d) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:26.692961 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.694443 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.703467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 47/92] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/role_assignments?user.id=105b635fff904668bf368a5753e43a9d&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=7f519a00587a4cb38cff222d59894a29 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:26.704455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.776878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 46/93] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:26.778029 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.806756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.850374 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25160a15-4d6d-44c4-9c57-937c7eafb2d4 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:26.905356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:26.905980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:26.906265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:26.906540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:26.907279 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] RBAC: Adding query filter params (role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=77ea6e472d944589af922adaecdc29f6) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:26.907617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:26.909432 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:26.919932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 48/94] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/role_assignments?user.id=77ea6e472d944589af922adaecdc29f6&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:26.919932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:26.947888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:27.022025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3bc4a-3f0e-4940-baa7-1cf7ab51495c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:27.090146 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920409c2-abac-4dfe-bdf4-b18268ee0b2e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:27.138079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:27.139084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:27.139573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:27.140058 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:27.143917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=77ea6e472d944589af922adaecdc29f6) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:27.143917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:27.143917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:27.161472 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 47/95] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/role_assignments?user.id=77ea6e472d944589af922adaecdc29f6&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 259 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:27.169840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747824-ae16-49cd-bb20-161376ee450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:27.170784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747824-ae16-49cd-bb20-161376ee450c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:27.171301 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747824-ae16-49cd-bb20-161376ee450c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:27.171734 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747824-ae16-49cd-bb20-161376ee450c None admin] PATH_INFO: `/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:27.173908 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2747824-ae16-49cd-bb20-161376ee450c None admin] RBAC: Authorizing `identity:get_project(project_id=35159bbfb15544f5bf0f1aadb92baaf4)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:27.175623 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2747824-ae16-49cd-bb20-161376ee450c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:27.181853 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 49/96] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:26 2022] GET /identity/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4 => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:27.188228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:27.309900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:27.333832 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb46c-5c19-4d36-b8a6-0ec2b1890e3d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:27.385006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:27.385640 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:27.385923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:27.386191 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:27.386921 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=35159bbfb15544f5bf0f1aadb92baaf4, user.id=77ea6e472d944589af922adaecdc29f6) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:27.387230 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:27.388726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3b968-703a-4525-8f2f-4a02bc8874db None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:27.400503 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 48/97] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:27 2022] GET /identity/v3/role_assignments?user.id=77ea6e472d944589af922adaecdc29f6&scope.project.id=35159bbfb15544f5bf0f1aadb92baaf4&role.id=9dab23bd829c4bd09bc84413f424696c => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:29.364568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49252-aa0f-4dc9-aef8-4a0b2cc67f86 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:29.365069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49252-aa0f-4dc9-aef8-4a0b2cc67f86 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:29.365172 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49252-aa0f-4dc9-aef8-4a0b2cc67f86 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:29.366587 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 50/98] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:29.377658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc26b0-8d5e-400a-a382-860bae9a5a2c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:29.378135 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc26b0-8d5e-400a-a382-860bae9a5a2c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:29.378208 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc26b0-8d5e-400a-a382-860bae9a5a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:29.404082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-c6cc26b0-8d5e-400a-a382-860bae9a5a2c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:29.405319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-c6cc26b0-8d5e-400a-a382-860bae9a5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:29.494841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 49/99] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:29.631412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5837c-2c5f-44d2-a9b5-dcef4e1ab3f6 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:29.631783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5837c-2c5f-44d2-a9b5-dcef4e1ab3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:29.632009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5837c-2c5f-44d2-a9b5-dcef4e1ab3f6 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:29.633358 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 51/100] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:29.638804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:29.639101 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:29.639387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:29.655472 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072750d3-3a21-468c-b1b6-3deec97983f0 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:29.656122 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072750d3-3a21-468c-b1b6-3deec97983f0 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:29.656628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072750d3-3a21-468c-b1b6-3deec97983f0 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:29.658196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 52/101] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:29.662224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:29.663719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:29.664214 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:29.664451 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:29.664916 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:29.693264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:29.694847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:29.760325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 50/102] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:29.819110 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 53/103] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:30.041236 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.045252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:30.195384 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1b98-5cf7-4d10-a8d3-3daa8dd73f39 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:30.252812 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:30.253459 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.253742 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.254015 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.255158 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:30.256671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:30.258437 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 51/104] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:30.264200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.300401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:30.408969 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.422702 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556ac0d-3d1b-4dcb-955e-0ef2771f99ef None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:30.470547 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:30.471181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.471472 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.471750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.472449 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:30.474122 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:30.541816 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 54/105] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 02:59:30 2022] POST /identity/v3/projects => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:30.543784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.573932 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:30.640726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673518-b500-4ac6-81e7-d0ca8b77d51d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:30.689314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:30.723036 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:30.724049 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.724545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.725007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.749827 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b052e7-82dd-4e57-9f76-a60be4c210bd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:30.761745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:30.767671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:30.768700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:30.769458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:30.780237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 52/106] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:30.781716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.841683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a69f3-4e53-4e5a-9e98-33abdbfd2f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:30.842680 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a69f3-4e53-4e5a-9e98-33abdbfd2f1e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.843264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a69f3-4e53-4e5a-9e98-33abdbfd2f1e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.843751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a69f3-4e53-4e5a-9e98-33abdbfd2f1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.871715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a69f3-4e53-4e5a-9e98-33abdbfd2f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-149a69f3-4e53-4e5a-9e98-33abdbfd2f1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:30.883889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:30.885312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:30.886197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:30.889152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 55/107] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:30.890812 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8cd5b-ff6e-40cc-8670-84ac4ecdaa86 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.891331 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8cd5b-ff6e-40cc-8670-84ac4ecdaa86 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.892730 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8cd5b-ff6e-40cc-8670-84ac4ecdaa86 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.899914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 56/108] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:30.901239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8cd5b-ff6e-40cc-8670-84ac4ecdaa86 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.997226 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db388e64-e790-4a41-a3dd-bcef2da99bcb None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.039926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:31.045317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.045977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.046332 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.046798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.047741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:31.048113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:31.049602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcf4c5-bbb4-47bc-8abc-14e1948937ff None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:31.057956 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8cd5b-ff6e-40cc-8670-84ac4ecdaa86 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.058936 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 53/109] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:31.059969 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.060263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.060544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.080002 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:31.081241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:31.085882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:31.093900 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.094442 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.094724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.095554 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.096617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:31.096617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:31.098071 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f20254-4edd-4836-8620-f9bcbf2f1761 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:31.107745 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 57/110] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:31.108858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bf5bd-b58b-402d-9ce3-ed54c9a4dfbc None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.109146 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bf5bd-b58b-402d-9ce3-ed54c9a4dfbc None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.109418 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bf5bd-b58b-402d-9ce3-ed54c9a4dfbc None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.110694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 58/111] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:31.116013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c854a-3fa7-40dc-bd3f-a28afdcb6d98 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.116303 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c854a-3fa7-40dc-bd3f-a28afdcb6d98 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.116638 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c854a-3fa7-40dc-bd3f-a28afdcb6d98 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.118259 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 59/112] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:31.118840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c854a-3fa7-40dc-bd3f-a28afdcb6d98 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:31.180960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 54/113] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:31.182265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:31.286663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c854a-3fa7-40dc-bd3f-a28afdcb6d98 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.288960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97c6a-614c-4d23-9b4b-e6d23264a203 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.314621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:31.330390 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96980f33-d12c-4bad-8719-571b8449e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.331376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980f33-d12c-4bad-8719-571b8449e769 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.331951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980f33-d12c-4bad-8719-571b8449e769 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.332586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980f33-d12c-4bad-8719-571b8449e769 None admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.334290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96980f33-d12c-4bad-8719-571b8449e769 None admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:31.336138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96980f33-d12c-4bad-8719-571b8449e769 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:31.342982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 55/114] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:31 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:31.344583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.345113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.345602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.354970 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e80e-4d63-4672-b74d-29797794102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.356089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e80e-4d63-4672-b74d-29797794102e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.356568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e80e-4d63-4672-b74d-29797794102e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.357069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e80e-4d63-4672-b74d-29797794102e None admin] PATH_INFO: `/v3/users/f313c382e85c409abb9f03a67b490b45` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.365566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:31.367043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:31.383408 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e80e-4d63-4672-b74d-29797794102e None admin] RBAC: Authorizing `identity:get_user(user_id=f313c382e85c409abb9f03a67b490b45)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:31.386257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e80e-4d63-4672-b74d-29797794102e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:31.394223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 60/115] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:31 2022] GET /identity/v3/users/f313c382e85c409abb9f03a67b490b45 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:31.394223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.394223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.394223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.425514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:31.427598 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:31.446494 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 56/116] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:31.448186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:31.512093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:31.561146 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 61/117] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:31.561476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:31.567078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b791-4cb0-420a-a860-845e638a6301 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.615148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:31.643230 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.644279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.644779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.645249 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.652503 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:31.654215 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:31.656426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 57/118] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:31 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:31.662726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:31.777495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bf0f8-eb8d-4be3-8847-c2962a59c9ad None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.825074 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.825742 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.826027 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.826306 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/105b635fff904668bf368a5753e43a9d/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.833099 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4eb447cdf07f48efaf2af44b4af271dc, user_id=105b635fff904668bf368a5753e43a9d, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:31.834559 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:31.839365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbeb1e-c760-4d85-b654-52921e694d8b None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:31.885734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 58/119] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:31 2022] PUT /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/105b635fff904668bf368a5753e43a9d/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:59:31.886590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:31.898248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:31.899420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:31.900058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:31.900542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:31.967227 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:32.006920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:32.027340 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.030134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892894-537d-4563-86cb-1dcdf79808f3 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.031661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.079936 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.081087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.081560 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.082035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.121220 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:32.141141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:32.142102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:32.142900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:32.144097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 59/120] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:32.150987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.211656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 62/121] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:32.221621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.379049 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bc07e-4ab5-4c06-af3a-f8369b111fef None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.386224 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:32.401737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabcd3-2460-4fa2-9578-f9d823299363 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.401878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:32.437395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.438379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.438880 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.439344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.440497 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:32.441027 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.443468 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.452337 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.453532 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.453993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.454985 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.456784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.458645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 60/122] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:32.459207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.459745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.462261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 63/123] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:32.463480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.628475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f13c1-ba3a-44e7-abd1-29448e07b9a5 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.637182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684eb53-0fd2-42fe-88a3-b45a0da24dec None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.685224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.686159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.686630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.687091 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.693967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.695132 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.695659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.696178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.705952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:32.713891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:32.715642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:32.716526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:32.717311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:32.719352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 61/124] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:32.719352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:32.723361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:32.725493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 64/125] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:32.727413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.743189 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:32.774458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:32.896527 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdc398-0769-4070-9c11-008b93e7a396 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.897513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102280cb-ae76-4f88-ad40-d7da234c8bc3 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.951384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.952651 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.953220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.953748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.955623 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] RBAC: Adding query filter params (role.id=84492bd7932f4ac8a6582006ac6dfbd2, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=f313c382e85c409abb9f03a67b490b45) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:32.956238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.956770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.957708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.958169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.958617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.958895 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.960430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.963039 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.966296 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 62/126] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:32.967531 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.968290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 65/127] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/role_assignments?user.id=f313c382e85c409abb9f03a67b490b45&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=84492bd7932f4ac8a6582006ac6dfbd2 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:32.969440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.151093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.156510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f9289-58a4-4380-a2c1-22b45d474544 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.168597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.215297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.216258 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.216708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.217216 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.218519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:33.219021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.222137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.238102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 63/128] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.239587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.287459 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58c5c-fc01-4627-8bf3-518cee3dfd44 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.410121 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.411035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.411322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.411591 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.412333 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:33.412640 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.413422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35102c9c-d5a1-4d95-9bfa-9e68cdc6faf8 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.414043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.424850 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 66/129] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 02:59:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.425713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.468279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2721b8e-e7db-404a-a885-3adca3d9aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.469197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721b8e-e7db-404a-a885-3adca3d9aacb None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.469660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721b8e-e7db-404a-a885-3adca3d9aacb None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.470686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721b8e-e7db-404a-a885-3adca3d9aacb None admin] PATH_INFO: `/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.472539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2721b8e-e7db-404a-a885-3adca3d9aacb None admin] RBAC: Authorizing `identity:get_project(project_id=35159bbfb15544f5bf0f1aadb92baaf4)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.475173 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2721b8e-e7db-404a-a885-3adca3d9aacb None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.478360 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 64/130] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.480348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ecc6-8db5-45da-8c1d-d722fb9acf7e None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.480808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ecc6-8db5-45da-8c1d-d722fb9acf7e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.481287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ecc6-8db5-45da-8c1d-d722fb9acf7e None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.483405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 65/131] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:33.484983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ecc6-8db5-45da-8c1d-d722fb9acf7e None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.538125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.539241 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec1ad-3476-4991-b705-b3db5aaf1cbd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.571591 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.577156 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.577895 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.578249 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.578599 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.580049 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.582014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.584298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 67/132] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.585130 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.670765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ecc6-8db5-45da-8c1d-d722fb9acf7e None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.707079 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e7202-5ee1-473b-bd3e-6cb9fb68a2ca None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.707348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47e90-b0a9-429a-9be6-11c330989db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.708193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47e90-b0a9-429a-9be6-11c330989db2 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.708544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47e90-b0a9-429a-9be6-11c330989db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.708889 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47e90-b0a9-429a-9be6-11c330989db2 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.710706 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47e90-b0a9-429a-9be6-11c330989db2 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.712331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47e90-b0a9-429a-9be6-11c330989db2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.714377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 66/133] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.715762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.716158 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.716511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.735309 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:33.737694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:33.746517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.747188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.747471 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.747748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] PATH_INFO: `/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4/users/77ea6e472d944589af922adaecdc29f6/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.750387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] RBAC: Authorizing `identity:create_grant(project_id=35159bbfb15544f5bf0f1aadb92baaf4, user_id=77ea6e472d944589af922adaecdc29f6, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.752149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.771088 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 68/134] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:33 2022] PUT /identity/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4/users/77ea6e472d944589af922adaecdc29f6/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:33.772237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.813627 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 67/135] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:33.814474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.849666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.868308 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.903507 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7c22-34fc-4511-9c32-7ad3ab3af361 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.949496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.950142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.950424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.950696 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.954299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.955792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.963467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 69/136] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.969626 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:34.014105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fffe5-a86c-49fd-b9aa-86994d9591c9 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:34.097928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:34.098872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.099156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.099431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.104519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:34.106218 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:34.108210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 68/137] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:34.114880 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:34.132985 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1c5e4-39c0-4eb7-8660-bb80526a4069 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:34.164625 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:34.175159 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:34.176242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.176681 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.176969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/77ea6e472d944589af922adaecdc29f6/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.179044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] RBAC: Authorizing `identity:create_grant(project_id=4eb447cdf07f48efaf2af44b4af271dc, user_id=77ea6e472d944589af922adaecdc29f6, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:34.180741 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:34.196641 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 70/138] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:33 2022] PUT /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/77ea6e472d944589af922adaecdc29f6/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:59:34.196990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:34.268825 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:34.276574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0227e5-1036-4eef-9c75-b9645a7460ba None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:34.310510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017065f5-87bf-44fa-a5dc-b0844f4ce522 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:34.343986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bfe65-208e-4ce1-82a2-c6cdf9e7602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:34.345385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfe65-208e-4ce1-82a2-c6cdf9e7602c None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.345672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfe65-208e-4ce1-82a2-c6cdf9e7602c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.346032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfe65-208e-4ce1-82a2-c6cdf9e7602c None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/77ea6e472d944589af922adaecdc29f6/roles/528407bf4d38459a97d4e921cd7f7123` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.346716 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:34.347372 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.347655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.347990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.349254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:34.350728 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:34.352380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 71/139] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:34.353356 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bfe65-208e-4ce1-82a2-c6cdf9e7602c None admin] RBAC: Authorizing `identity:create_grant(project_id=4eb447cdf07f48efaf2af44b4af271dc, user_id=77ea6e472d944589af922adaecdc29f6, role_id=528407bf4d38459a97d4e921cd7f7123)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:34.354905 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bfe65-208e-4ce1-82a2-c6cdf9e7602c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:34.361512 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:34.393758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 69/140] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:34 2022] PUT /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/77ea6e472d944589af922adaecdc29f6/roles/528407bf4d38459a97d4e921cd7f7123 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:59:34.457352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:34.518501 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed85e-f591-47f6-9866-5e23aa6bbdeb None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:34.567862 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c276-6dd5-4773-bf60-2392c75a6ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:34.568488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c276-6dd5-4773-bf60-2392c75a6ef4 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.568721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c276-6dd5-4773-bf60-2392c75a6ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.568971 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c276-6dd5-4773-bf60-2392c75a6ef4 None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.569654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c276-6dd5-4773-bf60-2392c75a6ef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:34.571169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c276-6dd5-4773-bf60-2392c75a6ef4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:34.600802 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 72/141] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:34 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:34.916426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ed9b-aee4-481e-ab8b-ad330230376d None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.917470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ed9b-aee4-481e-ab8b-ad330230376d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.917955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ed9b-aee4-481e-ab8b-ad330230376d None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.919540 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 70/142] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:34.926602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:34.927220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:34.927707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:34.949239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:34.950810 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:35.028048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 73/143] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:35.386960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ed9b-aee4-481e-ab8b-ad330230376d None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:35.516450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ed9b-aee4-481e-ab8b-ad330230376d None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:35.563481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:35.565003 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:35.565435 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:35.565853 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:35.588358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:35.596371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:35.597310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:35.598558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 71/144] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:35.605739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:35.665339 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:35.730379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9be52-7d93-4fe2-a823-f313f2f8f9c6 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:35.768227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:35.768842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:35.769122 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:35.769455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:35.770126 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:35.770482 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:35.771894 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:35.780663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 74/145] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:35.787004 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:35.807530 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:35.903428 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b7e4-9e6b-4486-b9b0-681ca5e756a3 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:35.949559 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:35.950184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:35.950469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:35.950745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] PATH_INFO: `/v3/users/105b635fff904668bf368a5753e43a9d` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:35.951929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] RBAC: Authorizing `identity:get_user(user_id=105b635fff904668bf368a5753e43a9d)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:35.953591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:35.955221 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 72/146] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:35 2022] GET /identity/v3/users/105b635fff904668bf368a5753e43a9d => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:35.960802 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:36.071454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9ace-4a0a-405d-a508-811f2ce1cc0f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:36.073909 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:36.108745 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:36.109402 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:36.109690 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:36.109967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:36.184103 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:36.185506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:36.295679 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 75/147] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:36.301401 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:36.426222 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:36.439861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0050550-9330-4445-bac1-9703fb0bbc14 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:36.486824 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddedad-dea2-4347-bac8-67b1643e3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:36.487460 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddedad-dea2-4347-bac8-67b1643e3963 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:36.487741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddedad-dea2-4347-bac8-67b1643e3963 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:36.488039 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddedad-dea2-4347-bac8-67b1643e3963 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:36.492532 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddedad-dea2-4347-bac8-67b1643e3963 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:36.494119 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddedad-dea2-4347-bac8-67b1643e3963 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:36.496222 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 73/148] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:36 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:36.502035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:36.528210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:36.629142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc70bd7-20ef-4f5f-98e4-8e9e6f2fdc2f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:36.671362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:36.672020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:36.672301 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:36.672575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:36.673879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=105b635fff904668bf368a5753e43a9d) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:36.674189 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:36.675749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb283-647b-4bd0-bd7c-638535dd7d11 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:36.686790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 76/149] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:36 2022] GET /identity/v3/role_assignments?user.id=105b635fff904668bf368a5753e43a9d&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=7f519a00587a4cb38cff222d59894a29 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:36.738912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034907-4d72-48d0-b53c-d20dea15c820 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:36.739267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034907-4d72-48d0-b53c-d20dea15c820 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:36.739547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034907-4d72-48d0-b53c-d20dea15c820 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:36.741091 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 74/150] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:36.752363 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:36.752648 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:36.752927 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:36.789496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:36.790706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:36.895325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:36.915660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 77/151] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:37.575271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034907-4d72-48d0-b53c-d20dea15c820 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:37.715378 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034907-4d72-48d0-b53c-d20dea15c820 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:37.757687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:37.758327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:37.758607 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:37.758877 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:37.772581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:37.777544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:37.778427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:37.779210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 75/152] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:37.786475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:37.916068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4bff7-afdf-44ac-acd2-f251569c16ac None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:37.975586 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:37.976253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:37.976538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:37.976809 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:37.977492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:37.977794 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:37.979223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95e415-aaac-4621-8c68-1755e55b347e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:37.996107 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 78/153] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:38.001754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:38.028243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:38.144806 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2841ae-cb63-4236-a454-6a98d2f98ad0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:38.157465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15930-cec2-473d-925a-fceb04203c54 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.157751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15930-cec2-473d-925a-fceb04203c54 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.158032 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15930-cec2-473d-925a-fceb04203c54 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.159485 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 79/154] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:38.165006 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.165340 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.165563 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.201069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:38.202207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:38.220732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:38.221384 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.221665 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.222342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] PATH_INFO: `/v3/users/f313c382e85c409abb9f03a67b490b45` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.225156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] RBAC: Authorizing `identity:get_user(user_id=f313c382e85c409abb9f03a67b490b45)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:38.226629 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:38.228423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 76/155] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:38 2022] GET /identity/v3/users/f313c382e85c409abb9f03a67b490b45 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:38.233751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:38.306196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:38.326694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 80/156] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:38.380212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:38.413266 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc023-ca6e-4b7a-bb38-dc61ff9a12fe None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:38.472956 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c816de2-9f74-4a8f-a653-289b7505acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:38.473517 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c816de2-9f74-4a8f-a653-289b7505acf8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.473803 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c816de2-9f74-4a8f-a653-289b7505acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.474066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c816de2-9f74-4a8f-a653-289b7505acf8 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.475200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c816de2-9f74-4a8f-a653-289b7505acf8 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:38.478829 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c816de2-9f74-4a8f-a653-289b7505acf8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:38.480645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 77/157] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:38 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:38.486982 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:38.527931 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251edb0-04b7-47f0-9d15-7db5da3de71f None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.528240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251edb0-04b7-47f0-9d15-7db5da3de71f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.528488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251edb0-04b7-47f0-9d15-7db5da3de71f None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.530782 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 78/158] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:38.536933 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cccaa4-7169-424f-b1e0-0250c0f4638c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.537224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cccaa4-7169-424f-b1e0-0250c0f4638c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.537489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cccaa4-7169-424f-b1e0-0250c0f4638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.570744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-47cccaa4-7169-424f-b1e0-0250c0f4638c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:38.571994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-47cccaa4-7169-424f-b1e0-0250c0f4638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:38.668025 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636702c-507e-4f3a-bd32-cef87cf140f2 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:38.703146 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 79/159] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:38.705558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dba663-cb79-4e05-b649-e5a51a7a8fb3 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.706013 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dba663-cb79-4e05-b649-e5a51a7a8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.706488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dba663-cb79-4e05-b649-e5a51a7a8fb3 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.712187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 80/160] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:38.722169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.722636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.723127 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.728742 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:38.728742 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:38.728742 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:38.728742 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/f313c382e85c409abb9f03a67b490b45/roles/84492bd7932f4ac8a6582006ac6dfbd2` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:38.733248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] RBAC: Authorizing `identity:create_grant(project_id=4eb447cdf07f48efaf2af44b4af271dc, user_id=f313c382e85c409abb9f03a67b490b45, role_id=84492bd7932f4ac8a6582006ac6dfbd2)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:38.734699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:38.755708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:38.757318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:38.762529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 81/161] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:38 2022] PUT /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/users/f313c382e85c409abb9f03a67b490b45/roles/84492bd7932f4ac8a6582006ac6dfbd2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:38.872923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:38.874148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 81/162] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:38.967575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:39.050011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81036a9b-7371-489d-b698-397d3f10315b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:39.089226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:39.089871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:39.090157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:39.090435 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:39.103504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:39.108867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:39.109874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:39.111194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 82/163] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 02:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:39.117472 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:39.136151 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:39.258938 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80271-da69-4ed4-b02c-4b3fbc260cbc None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:39.294789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:39.295405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:39.295684 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:39.295986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:39.296659 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:39.296963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:39.298865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:39.307660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 82/164] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 02:59:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:39.316871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:39.453011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d4a56-7675-4c7a-9611-9042827cebd3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:39.468721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:39.482712 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:39.504968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:39.505626 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:39.505905 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:39.506181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:39.507449 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:39.516101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:39.516101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 83/165] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:39 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:39.523850 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:39.604164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:39.644363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ec164-0477-452d-8958-1e0c0202db30 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:39.686146 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:39.687166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:39.687655 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:39.688221 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:39.701903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:39.711628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:39.713800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:39.716355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:39.721721 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 83/166] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:39.723328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:39.734092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2eb31-9976-45c8-a820-336e03c5322e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:39.861566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd5009-f1d4-4cfa-bef8-2b1b269aa809 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:39.867960 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:39.868794 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:39.869075 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:39.869604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:39.900115 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:39.900728 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:39.902917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:39.903775 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:39.904451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:39.904753 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:39.910633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:39.911597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:39.912427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:39.916218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 84/167] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:39.917540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.000334 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.003605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.075327 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:40.159281 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 84/168] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:40.160486 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.181410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e2279-a2fb-4a3e-b2a1-80537fdaa5da None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:40.204234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:40.229613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:40.231538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.232263 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.234123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.235671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:40.236524 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.239229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.260427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 85/169] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:40.263068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.364301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52cb46-546e-4b32-8290-1700ac9ae61c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:40.438469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:40.439700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.440601 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.441111 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.442087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:40.442570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.445045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97b137-5290-4060-af5c-a35ba8c70df1 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.453577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:40.457419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10511-bd5a-4248-b981-ef110ee3825f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:40.458864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 85/170] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:40.462425 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9149-5d97-4b41-89a6-06002d982f43 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.462911 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9149-5d97-4b41-89a6-06002d982f43 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.463357 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9149-5d97-4b41-89a6-06002d982f43 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.465461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 86/171] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:40.466724 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9149-5d97-4b41-89a6-06002d982f43 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.500986 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091728c4-9bed-49f4-80fd-c5ac6f474157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:40.501779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091728c4-9bed-49f4-80fd-c5ac6f474157 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.502120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091728c4-9bed-49f4-80fd-c5ac6f474157 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.502486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091728c4-9bed-49f4-80fd-c5ac6f474157 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.503739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091728c4-9bed-49f4-80fd-c5ac6f474157 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.505374 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091728c4-9bed-49f4-80fd-c5ac6f474157 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.507182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 86/172] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:40.512514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507c41-d424-4a69-9ca4-4babc92ffe23 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.512514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507c41-d424-4a69-9ca4-4babc92ffe23 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.512514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507c41-d424-4a69-9ca4-4babc92ffe23 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.514582 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 87/173] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:40.515438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507c41-d424-4a69-9ca4-4babc92ffe23 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.590081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:40.602260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9149-5d97-4b41-89a6-06002d982f43 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:40.631357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507c41-d424-4a69-9ca4-4babc92ffe23 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:40.643393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c0dda-5a62-4285-a2ce-4eb34296dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:40.644133 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0dda-5a62-4285-a2ce-4eb34296dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.644547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0dda-5a62-4285-a2ce-4eb34296dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.644830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0dda-5a62-4285-a2ce-4eb34296dbc5 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.645901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0dda-5a62-4285-a2ce-4eb34296dbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.647426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0dda-5a62-4285-a2ce-4eb34296dbc5 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.653672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 87/174] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:40.653672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d83b-83fc-4cec-825f-cd36612b6ca0 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.653672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d83b-83fc-4cec-825f-cd36612b6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.653672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d83b-83fc-4cec-825f-cd36612b6ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.670111 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-7164d83b-83fc-4cec-825f-cd36612b6ca0 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:40.671387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-7164d83b-83fc-4cec-825f-cd36612b6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:40.673839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:40.674476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.674755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.675014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] PATH_INFO: `/v3/users/77ea6e472d944589af922adaecdc29f6` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.676162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] RBAC: Authorizing `identity:get_user(user_id=77ea6e472d944589af922adaecdc29f6)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.677585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.684000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 88/175] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/users/77ea6e472d944589af922adaecdc29f6 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:40.684000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.717784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:40.763839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 88/176] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:40.763839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.763839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.763839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.781311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:40.783192 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:40.802548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642cda-09d1-45b0-9fdf-629ae1097d24 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:40.839533 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:40.840450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.840799 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.841141 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.841943 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] RBAC: Adding query filter params (role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=77ea6e472d944589af922adaecdc29f6) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:40.842322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:40.844392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cefe2-8730-4630-bb14-ca18e5e40bbf None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:40.851415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 89/177] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/role_assignments?user.id=77ea6e472d944589af922adaecdc29f6&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:40.860618 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4a5f-b180-4b25-ac45-c90234edd9d8 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:40.860995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4a5f-b180-4b25-ac45-c90234edd9d8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:40.861308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4a5f-b180-4b25-ac45-c90234edd9d8 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:40.862271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 89/178] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:40.863289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 90/179] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:40.864175 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4a5f-b180-4b25-ac45-c90234edd9d8 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.867517 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:40.921193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.014991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4a5f-b180-4b25-ac45-c90234edd9d8 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.019628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.056845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e887c7-9c23-46d6-8a74-aa0541d401cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.057594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e887c7-9c23-46d6-8a74-aa0541d401cf None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.058042 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e887c7-9c23-46d6-8a74-aa0541d401cf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.058402 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e887c7-9c23-46d6-8a74-aa0541d401cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.087247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc4ce-2569-426e-9238-205a6b63c035 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.146655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e887c7-9c23-46d6-8a74-aa0541d401cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.149826 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e887c7-9c23-46d6-8a74-aa0541d401cf None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.167326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.168016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.168301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.168573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.310378 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.312036 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.317044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.324786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 91/180] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:41.331020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.331502 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.331982 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.351029 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.362379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:41.363940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:41.450971 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 92/181] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:41.451612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.458375 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 90/182] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:41.459879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.579488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff13fe2-7115-45fa-a1e3-06d57ed2c28d None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.581928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f25882-fb60-4037-9f25-9de6d754957a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.604926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.622758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.623399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.623680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.623983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.624090 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.625279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.627578 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.629467 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 91/183] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:41.630253 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.633977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.641991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.641991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.641991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.653925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:41.659222 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:41.660234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:41.661034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 93/184] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:41.661694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.762284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f35638-bafb-4fce-8479-8f3457b889f7 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.776181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42945c4-8a9c-4ed2-ad32-6e0c331b9e5e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.805172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.805868 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.806185 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.806461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.807606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.809194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.811918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 92/185] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:41.812116 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.817502 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.818342 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.818616 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.818881 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] PATH_INFO: `/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.820054 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] RBAC: Authorizing `identity:get_project(project_id=35159bbfb15544f5bf0f1aadb92baaf4)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.821499 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.823104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 94/186] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/projects/35159bbfb15544f5bf0f1aadb92baaf4 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:41.823879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.874803 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.888320 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.918841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2a005-eac0-4b7c-a67e-3c5c7287ef6f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.930772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e4f90-64ea-41ae-9f24-dabdb5a72e97 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.952656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.953271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.953550 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.954353 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.955087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=77ea6e472d944589af922adaecdc29f6) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:41.955376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.956874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.962908 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 93/187] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/role_assignments?user.id=77ea6e472d944589af922adaecdc29f6&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:41.963505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.967850 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.968510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.968791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.969066 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.969792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:41.970101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.971548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.988795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 95/188] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:41.988795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:42.087414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c838-7ea5-41c4-a27b-ca1d262566a2 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.107612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196fe3-a8d1-4006-9165-f212096c4e42 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.113232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:42.132242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0488bf5-650c-48f5-a5d7-5b0940f8e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.132804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0488bf5-650c-48f5-a5d7-5b0940f8e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.133080 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0488bf5-650c-48f5-a5d7-5b0940f8e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.133542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:42.133863 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0488bf5-650c-48f5-a5d7-5b0940f8e9f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.149566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0488bf5-650c-48f5-a5d7-5b0940f8e9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:42.152352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.152721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.153014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.153290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.153937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-f0488bf5-650c-48f5-a5d7-5b0940f8e9f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:42.154944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:42.155942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:42.156826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:42.157437 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:42.157505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 94/189] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:42.157505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbd40-6803-48c0-a791-68bd7bfd9741 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.157632 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbd40-6803-48c0-a791-68bd7bfd9741 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.158286 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbd40-6803-48c0-a791-68bd7bfd9741 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.159183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 95/190] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:42.164592 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbd40-6803-48c0-a791-68bd7bfd9741 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:42.180557 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 96/191] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:41 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:42.181243 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:42.314384 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbd40-6803-48c0-a791-68bd7bfd9741 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.323774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b85c0-74fe-4df0-b08f-50d40534a63f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.363449 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.364108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.364391 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.364553 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.364662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.365181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.365415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=35159bbfb15544f5bf0f1aadb92baaf4, user.id=77ea6e472d944589af922adaecdc29f6) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:42.365516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.365685 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:42.365779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] PATH_INFO: `/v3/users/2fca760624894896b4ce3fc48e430bec` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.367196 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45fdf8-3d30-4857-9ada-b4683d407ac5 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:42.374626 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 96/192] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:42 2022] GET /identity/v3/role_assignments?user.id=77ea6e472d944589af922adaecdc29f6&scope.project.id=35159bbfb15544f5bf0f1aadb92baaf4&role.id=9dab23bd829c4bd09bc84413f424696c => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:42.380187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.380502 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.380996 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.382048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] RBAC: Authorizing `identity:get_user(user_id=2fca760624894896b4ce3fc48e430bec)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:42.383663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:42.386307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 97/193] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:42 2022] GET /identity/v3/users/2fca760624894896b4ce3fc48e430bec => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:42.386307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:42.405769 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:42.407526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:42.428250 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:42.461637 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:42.508323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 97/194] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:42.509539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:42.556008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78c00-cca9-4ae6-a9d9-0bd1247e868c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.611069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.611692 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.612031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.612306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.612976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:42.613311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:42.614894 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:42.625511 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 98/195] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 02:59:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:42.631366 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:42.650729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65b05-db81-40b0-9e3f-1f3cbd00bf88 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.708037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.708951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.709234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.709503 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.776245 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:42.779880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4f03-d807-473c-8d73-3b62128f8a4a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:42.786140 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:42.822668 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:42.824277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:42.871805 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:42.872298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:42.872530 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:42.872885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] PATH_INFO: `/v3/users/2fca760624894896b4ce3fc48e430bec` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:42.874888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] RBAC: Authorizing `identity:get_user(user_id=2fca760624894896b4ce3fc48e430bec)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:42.876120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:42.878089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 99/196] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:42 2022] GET /identity/v3/users/2fca760624894896b4ce3fc48e430bec => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:42.884936 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.001278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 98/197] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:43.002772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.040962 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce678bdd-2621-44f0-8171-02713732130f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.090925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.092227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.092688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.093107 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.104163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:43.144775 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:43.147805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62df39-3eb3-42d9-9acd-318a0c51ae6f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.206511 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:43.207669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.208587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.209131 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.209446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:43.209858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.223701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:43.228977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:43.229930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:43.230732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:43.233587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 99/198] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:43.234652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.357115 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 100/199] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:43.358465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.371383 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7586-c65a-4935-aaf7-a0556c2b8330 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.417356 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.418425 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.418937 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.419412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.421184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:43.422964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:43.424999 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 100/200] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:43.430935 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.434164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:43.438554 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:43.489656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96488-6ccc-47f2-a8da-0e08280d48ae None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.537102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.538223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.538709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.539184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.540205 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:43.540733 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:43.542371 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:43.549864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c5845-144f-49fa-8a47-f4f7a79a5ea5 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.552662 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 101/201] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:43.553759 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.597053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.598809 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.599594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.600138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.601597 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:43.608474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:43.611990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 101/202] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:43.613583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.686588 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f157-eeb0-4bd7-97a4-d35eafba3c2b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.718302 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:43.727519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:43.740721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.741616 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.742078 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.742500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.743438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=2fca760624894896b4ce3fc48e430bec) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:43.744342 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:43.746088 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:43.752820 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 102/203] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/role_assignments?user.id=2fca760624894896b4ce3fc48e430bec&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=7f519a00587a4cb38cff222d59894a29 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:43.753983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.791115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3e0d-9ad7-4278-963f-736729b55f8c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:43.861198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:43.864854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:43.866674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:43.870683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] PATH_INFO: `/v3/users/f313c382e85c409abb9f03a67b490b45` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:43.872666 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=f313c382e85c409abb9f03a67b490b45)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:43.874718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:43.879649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 102/204] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/users/f313c382e85c409abb9f03a67b490b45 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:43.889040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:43.996363 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dea29-ba86-4da7-bc98-fe134c4a2d5a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:44.059334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:44.059782 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:44.059989 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:44.060242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:44.061941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] RBAC: Adding query filter params (role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=2fca760624894896b4ce3fc48e430bec) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:44.061941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:44.063458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:44.075894 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 103/205] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/role_assignments?user.id=2fca760624894896b4ce3fc48e430bec&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:44.076096 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d96c5-0828-4eed-8bfb-fb786b636ed0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:44.139937 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:44.140531 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:44.140813 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:44.141762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:44.156344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:44.248311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:44.249845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:44.382399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 103/206] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:44.388484 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:44.492309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:44.552015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228122d7-c503-4e6a-aa46-6d08c7194f3c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:44.589768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f566-e67d-4232-813d-1f23f712a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:44.590421 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f566-e67d-4232-813d-1f23f712a695 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:44.590705 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f566-e67d-4232-813d-1f23f712a695 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:44.590986 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f566-e67d-4232-813d-1f23f712a695 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:44.592209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f566-e67d-4232-813d-1f23f712a695 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:44.593714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f566-e67d-4232-813d-1f23f712a695 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:44.595976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 104/207] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:44 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:44.604475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:44.673758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:44.743315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d761de8-b61e-46b7-a544-a1a16a4d9224 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:44.779710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:44.780353 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:44.780633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:44.780904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:44.782149 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] RBAC: Adding query filter params (role.id=84492bd7932f4ac8a6582006ac6dfbd2, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc, user.id=f313c382e85c409abb9f03a67b490b45) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:44.782461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:44.783946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7420-ea43-44e7-b506-5ebfc9b23ba1 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:44.791076 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 104/208] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:44 2022] GET /identity/v3/role_assignments?user.id=f313c382e85c409abb9f03a67b490b45&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=84492bd7932f4ac8a6582006ac6dfbd2 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:45.107588 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbce35-28e2-4a03-a5da-9a13145f67e2 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:45.107964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbce35-28e2-4a03-a5da-9a13145f67e2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:45.108220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbce35-28e2-4a03-a5da-9a13145f67e2 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:45.110170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 105/209] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:45.116035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bccb-05dd-469b-96e3-2265234372f8 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:45.116555 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bccb-05dd-469b-96e3-2265234372f8 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:45.116665 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bccb-05dd-469b-96e3-2265234372f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:45.167539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-dde9bccb-05dd-469b-96e3-2265234372f8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:45.169119 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-dde9bccb-05dd-469b-96e3-2265234372f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:45.247906 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 105/210] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:45.321528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc62790-a181-4214-a562-e1f7cb8896f8 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:45.321786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc62790-a181-4214-a562-e1f7cb8896f8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:45.322068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc62790-a181-4214-a562-e1f7cb8896f8 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:45.323657 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 106/211] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:45.331271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:45.331602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:45.331859 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:45.350994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:45.352228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:45.381288 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:45.428121 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 106/212] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:45.665601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc62790-a181-4214-a562-e1f7cb8896f8 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:45.774841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:45.808253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc62790-a181-4214-a562-e1f7cb8896f8 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:45.845964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:45.853715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:45.854365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:45.854689 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:45.854944 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:45.871525 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:45.877055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:45.878833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:45.880355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 107/213] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:45.888813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:45.946043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352678f5-3238-49df-bb7d-9bd3409cf666 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:45.983371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:45.984401 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:45.985450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:45.986096 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:45.987480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:45.989209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:45.991488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 107/214] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:45.998652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:46.023365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838e1e9-1ba9-4ba6-9ac2-27d6aa6bc55c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:46.034496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:46.068864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:46.070087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.070612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.075579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.076358 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:46.076667 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:46.078123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:46.099089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 108/215] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:46.107849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:46.144518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd688-afc9-4bd5-a32e-a7981033e165 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:46.186618 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:46.199571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:46.201212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.201748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.202218 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.203746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:46.205971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:46.236819 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 108/216] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:45 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:59:46.257340 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84261b6-babe-4e3b-b1ec-caeddd8d1980 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:46.300028 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:46.300694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.300974 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.301250 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] PATH_INFO: `/v3/users/de70c0cb49734050912cbeff4259773b` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.318526 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] RBAC: Authorizing `identity:get_user(user_id=de70c0cb49734050912cbeff4259773b)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:46.320053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:46.322015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 109/217] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:46 2022] GET /identity/v3/users/de70c0cb49734050912cbeff4259773b => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:46.327644 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:46.433631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:46.451124 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef620c-6a05-4592-8108-329ebc146639 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:46.491731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bcfe4-7d24-4948-acbf-17e6d20cc306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:46.492474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bcfe4-7d24-4948-acbf-17e6d20cc306 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.492823 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bcfe4-7d24-4948-acbf-17e6d20cc306 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.493172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bcfe4-7d24-4948-acbf-17e6d20cc306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.574369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bcfe4-7d24-4948-acbf-17e6d20cc306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:46.575965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bcfe4-7d24-4948-acbf-17e6d20cc306 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:46.682341 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:46.701123 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 109/218] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:46.708034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:46.711481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469928-e05e-4643-8031-fd421b2881c8 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.712078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469928-e05e-4643-8031-fd421b2881c8 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.712547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469928-e05e-4643-8031-fd421b2881c8 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.714072 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 110/219] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:46.720175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.720782 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.721245 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.742512 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:46.744787 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:46.819242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 111/220] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:46.852672 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9a450-c476-4d1c-90f7-db2c4dbd90cf None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:46.854428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:46.893401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ac68-37f8-4c0a-9776-be07ff443f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:46.894549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ac68-37f8-4c0a-9776-be07ff443f20 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:46.895070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ac68-37f8-4c0a-9776-be07ff443f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:46.895582 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ac68-37f8-4c0a-9776-be07ff443f20 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:46.898209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5ac68-37f8-4c0a-9776-be07ff443f20 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:46.901258 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5ac68-37f8-4c0a-9776-be07ff443f20 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:46.904504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 110/221] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:46 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:46.913490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:47.052903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb148723-2b22-47c2-a41b-dc073f6e78e6 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:47.082587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:47.117818 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:47.118452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:47.118735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:47.119261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:47.120028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=de70c0cb49734050912cbeff4259773b) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:47.120337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:47.121857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00aae8-78b0-4909-b0e6-b291a3de7dea None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:47.131872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 112/222] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:46 2022] GET /identity/v3/role_assignments?user.id=de70c0cb49734050912cbeff4259773b&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:47.147891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a814-0aa0-4b25-ac5f-c544d4b6d275 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:47.148512 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a814-0aa0-4b25-ac5f-c544d4b6d275 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:47.148790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a814-0aa0-4b25-ac5f-c544d4b6d275 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:47.150287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 111/223] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:47.156139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:47.157170 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:47.157779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:47.183579 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:47.185277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:47.282379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 113/224] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:47.368870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a814-0aa0-4b25-ac5f-c544d4b6d275 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:47.510297 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a814-0aa0-4b25-ac5f-c544d4b6d275 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:47.560094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:47.561435 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:47.562129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:47.563381 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:47.582426 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:47.592701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:47.594783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:47.596906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:47.600903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 112/225] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:47.607874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:47.654182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:47.718850 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0741fb8-ab42-496e-b7fe-67b80d875a1d None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:47.730522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:47.743263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:47.767796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:47.768717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:47.769144 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:47.769557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:47.770373 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:47.770821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:47.772536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:47.782597 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 114/226] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:47.788839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:47.881316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81225f-dc15-4ff9-abf6-9af29d2688cd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:47.982595 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:47.983471 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:47.983876 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:47.984248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.001378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:48.006934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:48.008039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:48.009022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:48.009848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 113/227] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 02:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:59:48.017041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:48.053326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f307d7-1f68-427f-82d9-fd270b289219 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:48.137502 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:48.138065 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:48.138347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:48.138621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] PATH_INFO: `/v3/users/2fca760624894896b4ce3fc48e430bec` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.139764 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] RBAC: Authorizing `identity:get_user(user_id=2fca760624894896b4ce3fc48e430bec)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:48.141795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:48.143378 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 115/228] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:47 2022] GET /identity/v3/users/2fca760624894896b4ce3fc48e430bec => generated 283 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:48.155488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:48.220265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:48.232285 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:48.242055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28687299-de1b-4127-9e7f-1ccf09f64f50 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:48.295916 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aecea-f79f-499c-9fab-c5c74c14dc57 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:48.315135 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:48.315753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:48.316066 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:48.316346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.317018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:48.317324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:48.328025 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:48.343971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:48.345904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:48.349358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:48.349974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.351132 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 114/229] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 02:59:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:48.352024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:48.354921 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:48.356701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:48.358932 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 116/230] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:48 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:48.369544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:48.482055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cddae-f583-4a12-b1d1-3fdbca86a611 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:48.500732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:48.523976 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:48.525559 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:48.526050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:48.526526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/2fca760624894896b4ce3fc48e430bec/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.529317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] RBAC: Authorizing `identity:create_grant(project_id=c05a289ca3534ce698aab7ae7dfcc8dc, user_id=2fca760624894896b4ce3fc48e430bec, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:48.531033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:48.549464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 117/231] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:48 2022] PUT /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/2fca760624894896b4ce3fc48e430bec/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:48.660975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b6d4-5afa-410a-8a2f-cac586b04ef0 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:48.719903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:48.720980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:48.721482 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:48.721957 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] PATH_INFO: `/v3/users/2fca760624894896b4ce3fc48e430bec` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.723519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] RBAC: Authorizing `identity:get_user(user_id=2fca760624894896b4ce3fc48e430bec)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:48.725428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:48.727772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 115/232] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:48 2022] GET /identity/v3/users/2fca760624894896b4ce3fc48e430bec => generated 283 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:48.737209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:48.862469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb955-d725-4bb1-af24-0dcbc2bc5802 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:48.904926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c208e3-622e-4cb5-b03b-83462a154d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:48.905960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c208e3-622e-4cb5-b03b-83462a154d70 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:48.906563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c208e3-622e-4cb5-b03b-83462a154d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:48.907061 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c208e3-622e-4cb5-b03b-83462a154d70 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:48.908847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c208e3-622e-4cb5-b03b-83462a154d70 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:48.910565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c208e3-622e-4cb5-b03b-83462a154d70 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:48.912524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 118/233] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:48 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:48.918578 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:48.954440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:49.082369 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a9d9-0050-4cfb-b8d5-11fb9bb763b9 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:49.132361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96062707-75bd-4203-9efb-0bdf82b37843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:49.133453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96062707-75bd-4203-9efb-0bdf82b37843 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:49.133883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96062707-75bd-4203-9efb-0bdf82b37843 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:49.134319 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96062707-75bd-4203-9efb-0bdf82b37843 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/2fca760624894896b4ce3fc48e430bec/roles/528407bf4d38459a97d4e921cd7f7123` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:49.136742 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96062707-75bd-4203-9efb-0bdf82b37843 None admin] RBAC: Authorizing `identity:create_grant(project_id=c05a289ca3534ce698aab7ae7dfcc8dc, user_id=2fca760624894896b4ce3fc48e430bec, role_id=528407bf4d38459a97d4e921cd7f7123)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:49.138402 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96062707-75bd-4203-9efb-0bdf82b37843 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:49.157813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 116/234] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:48 2022] PUT /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/2fca760624894896b4ce3fc48e430bec/roles/528407bf4d38459a97d4e921cd7f7123 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:49.428132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9ba7-00a2-4612-8768-bc38390f8c17 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:49.428657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9ba7-00a2-4612-8768-bc38390f8c17 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:49.428946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9ba7-00a2-4612-8768-bc38390f8c17 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:49.430694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 119/235] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:49.435987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92759ed6-16a9-4677-bf36-c900c00e1e2f None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:49.436569 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92759ed6-16a9-4677-bf36-c900c00e1e2f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:49.436990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92759ed6-16a9-4677-bf36-c900c00e1e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:49.456649 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-92759ed6-16a9-4677-bf36-c900c00e1e2f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:49.458179 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-92759ed6-16a9-4677-bf36-c900c00e1e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:49.556844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 117/236] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:49.770813 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ce70-c53d-4cd5-bb39-982d46b51b61 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:49.771467 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ce70-c53d-4cd5-bb39-982d46b51b61 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:49.771976 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ce70-c53d-4cd5-bb39-982d46b51b61 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:49.773756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 120/237] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:49.779727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ec00-018b-4db5-8439-d38a0514e293 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:49.780437 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ec00-018b-4db5-8439-d38a0514e293 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:49.780932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ec00-018b-4db5-8439-d38a0514e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:49.801323 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-9057ec00-018b-4db5-8439-d38a0514e293 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:49.802872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-9057ec00-018b-4db5-8439-d38a0514e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:49.806947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:49.927681 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 118/238] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:50.002976 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843ce70-c53d-4cd5-bb39-982d46b51b61 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:50.076807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:50.094915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c1eb-c90d-498f-b58b-c405f77a5c87 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:50.095317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c1eb-c90d-498f-b58b-c405f77a5c87 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:50.095471 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c1eb-c90d-498f-b58b-c405f77a5c87 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:50.097577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 119/239] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:50.103499 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:50.103851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:50.104129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:50.145450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:50.148143 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:50.257081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843ce70-c53d-4cd5-bb39-982d46b51b61 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:50.295935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 120/240] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:50.316415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:50.317408 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:50.317861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:50.318305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:50.320058 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:50.323167 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:50.331431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 121/241] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:50.337149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:50.396104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:50.442372 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:50.510068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a6827-4319-4ea0-be50-e8c6fac3994d None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:50.570362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:50.571382 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:50.571877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:50.572329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:50.573653 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:50.576656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:50.579748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529fac-47a4-4a4a-87c1-56a0a9c6afdb None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:50.588348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:50.628307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 121/242] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:50 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:50.640268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:50.641525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:50.641959 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:50.643699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:50.662673 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:50.672990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:50.673993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:50.674837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:50.675723 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 122/243] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:50.681101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:50.837713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86286-406d-46ac-bf9e-1512750352cf None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:50.850394 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:50.877561 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:50.891787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:50.893640 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:50.893923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:50.894194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:50.894859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:50.895197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:50.897667 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:50.909227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 122/244] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:50.915084 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:50.993818 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f3c2-70df-4797-a168-48ac9d46bdd8 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.049507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.050309 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.050584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.050854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.065463 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:51.068859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba716de5-dad4-49ae-a6d2-02685cc12d51 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:51.070755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:51.071895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:51.073612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:51.077620 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 123/245] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:51.077867 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:51.120631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:51.137709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.139292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.139949 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.140706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] PATH_INFO: `/v3/users/6004119d123c44429c15609bcd4a0b82` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.163863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] RBAC: Authorizing `identity:get_user(user_id=6004119d123c44429c15609bcd4a0b82)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:51.168875 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:51.171322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 123/246] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:50 2022] GET /identity/v3/users/6004119d123c44429c15609bcd4a0b82 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:51.180859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:51.213603 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f1c69-9d8f-4ce3-8bc2-d74b90dad658 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.241971 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:51.253881 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.254887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.255343 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.255830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.256645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:51.257211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:51.258643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:51.268219 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 124/247] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:51.274037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:51.333113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b082fa-f99e-4a73-8a2f-ade8cbe12b12 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.397781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb43d68-7175-46ac-a8a3-a06b49d9bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.399483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb43d68-7175-46ac-a8a3-a06b49d9bf80 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.400408 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb43d68-7175-46ac-a8a3-a06b49d9bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.400959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb43d68-7175-46ac-a8a3-a06b49d9bf80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.403317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:51.423465 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5f580-1f51-4a3d-9112-5ad7185a9819 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.469650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.470382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.470850 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.471126 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] PATH_INFO: `/v3/users/de70c0cb49734050912cbeff4259773b` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.472342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] RBAC: Authorizing `identity:get_user(user_id=de70c0cb49734050912cbeff4259773b)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:51.473932 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:51.475921 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 125/248] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:51 2022] GET /identity/v3/users/de70c0cb49734050912cbeff4259773b => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:51.481956 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:51.506361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb43d68-7175-46ac-a8a3-a06b49d9bf80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:51.508427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb43d68-7175-46ac-a8a3-a06b49d9bf80 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:51.594709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:51.647993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7453a-2eba-4fb8-939b-795496c585da None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.688424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ca18-67a4-4934-bbfb-fe34dd56f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.689568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ca18-67a4-4934-bbfb-fe34dd56f55e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.690001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ca18-67a4-4934-bbfb-fe34dd56f55e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.690414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ca18-67a4-4934-bbfb-fe34dd56f55e None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.691871 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ca18-67a4-4934-bbfb-fe34dd56f55e None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:51.693337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ca18-67a4-4934-bbfb-fe34dd56f55e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:51.695291 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 126/249] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:51 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:51.697168 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa6bc-4ce1-40a2-840f-b78d92948695 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.697714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa6bc-4ce1-40a2-840f-b78d92948695 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.697997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa6bc-4ce1-40a2-840f-b78d92948695 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.699507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 127/250] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:51.700073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 124/251] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:51.704961 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa6bc-4ce1-40a2-840f-b78d92948695 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:51.705841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.706133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.706409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.731875 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:51.733101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:51.757392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:51.841245 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 125/252] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:51.842140 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:51.892030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa6bc-4ce1-40a2-840f-b78d92948695 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:51.954751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:51.955393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:51.955674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:51.955968 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/de70c0cb49734050912cbeff4259773b/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:51.959641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] RBAC: Authorizing `identity:create_grant(project_id=c05a289ca3534ce698aab7ae7dfcc8dc, user_id=de70c0cb49734050912cbeff4259773b, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:51.961139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:51.986490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 128/253] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:51 2022] PUT /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/de70c0cb49734050912cbeff4259773b/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:59:52.030837 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:52.067376 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a61aa-8c6d-46a5-abcc-c179ac60a55f None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:52.115845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a654e0-de80-4dfe-8c00-491763f54235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:52.116485 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a654e0-de80-4dfe-8c00-491763f54235 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:52.116788 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a654e0-de80-4dfe-8c00-491763f54235 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:52.117026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a654e0-de80-4dfe-8c00-491763f54235 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:52.119754 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a654e0-de80-4dfe-8c00-491763f54235 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:52.121279 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a654e0-de80-4dfe-8c00-491763f54235 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:52.123047 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 126/254] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:51 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:52.142079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:52.232402 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47863-9fd7-4cf3-9209-1f43626aa132 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:52.232693 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47863-9fd7-4cf3-9209-1f43626aa132 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:52.232868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47863-9fd7-4cf3-9209-1f43626aa132 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:52.234188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 127/255] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:52.239972 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:52.240255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:52.240530 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:52.261528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:52.262985 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:52.265435 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:52.310220 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62baf-3e66-44db-8ab2-3c3d4981324f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:52.366321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 128/256] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:52.418515 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:52.419148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:52.419429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:52.419707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:52.420479 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] RBAC: Adding query filter params (role.id=84492bd7932f4ac8a6582006ac6dfbd2, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=6004119d123c44429c15609bcd4a0b82) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:52.420794 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:52.422443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:52.432424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 129/257] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:52 2022] GET /identity/v3/role_assignments?user.id=6004119d123c44429c15609bcd4a0b82&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=84492bd7932f4ac8a6582006ac6dfbd2 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:52.458781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:52.547757 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:52.582460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e9088-e968-4ef0-abbd-7a1a97a5a4f7 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:52.637124 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:52.637806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:52.638085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:52.638360 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:52.657111 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:52.662021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:52.662976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:52.663803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 129/258] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 02:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:52.669692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:52.810510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7d977-b50a-454c-844f-8ab893cf2d10 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:52.851317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:52.852468 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:52.853035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:52.853556 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:52.853965 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:52.854647 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:52.855163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:52.856840 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:52.868518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 130/259] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:52.878323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:52.902738 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:53.064241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18faeee-f955-437a-9e2b-cf8651964281 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:53.102071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:53.102666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8bd0-68f9-491f-86d0-fe8bf17fdde9 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:53.103365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:53.103902 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:53.104416 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] PATH_INFO: `/v3/users/2fca760624894896b4ce3fc48e430bec` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:53.105823 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] RBAC: Authorizing `identity:get_user(user_id=2fca760624894896b4ce3fc48e430bec)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:53.107473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:53.109626 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 131/260] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:52 2022] GET /identity/v3/users/2fca760624894896b4ce3fc48e430bec => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:53.116646 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:53.173559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:53.174265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:53.174488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:53.174765 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:53.188913 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:53.205467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:53.210257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:53.211223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:59:53.212087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:53.220323 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 130/261] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 02:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:59:53.224851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:53.256290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:53.306854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e1c4-13dd-450d-bfb6-3aebc1588514 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:53.397934 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:53.398953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:53.399496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:53.400018 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:53.456253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a5520-a35e-4fc0-8c41-7f3c6bff049f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:53.473318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:53.475246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:53.517580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:53.518003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:53.518466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:53.518751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:53.519444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:53.519754 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:53.521262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:53.535729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 131/262] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 02:59:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:53.541334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:53.559127 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:53.585561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 132/263] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:53.595517 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:53.622722 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:53.691564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbca8a-9987-4d0a-8d8b-130ed2871cbc None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:53.762614 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:53.763289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:53.763573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:53.764019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] PATH_INFO: `/v3/users/2fca760624894896b4ce3fc48e430bec` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:53.771409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] RBAC: Authorizing `identity:get_user(user_id=2fca760624894896b4ce3fc48e430bec)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:53.772974 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:53.774678 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 132/264] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:53 2022] GET /identity/v3/users/2fca760624894896b4ce3fc48e430bec => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:53.782913 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:53.815729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3249fca-6840-45a5-9f55-1274438aae9e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:53.895422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:53.896564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:53.897047 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:53.897517 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:53.904745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:53.906752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:53.909174 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 133/265] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:53 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:53.917422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:54.005728 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:54.020092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4debdf-55f5-4a32-8e5a-e89618045dfb None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.096203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:54.124863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b5713-6c49-4879-8999-8d2ad8201de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.126229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b5713-6c49-4879-8999-8d2ad8201de7 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.126727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b5713-6c49-4879-8999-8d2ad8201de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.127113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b5713-6c49-4879-8999-8d2ad8201de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.169482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985b0d8-db38-41a7-b2c7-d6e79d57bd34 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.212512 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b5713-6c49-4879-8999-8d2ad8201de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.214015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b5713-6c49-4879-8999-8d2ad8201de7 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.264438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.265122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.265430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.265720 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.266464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=2fca760624894896b4ce3fc48e430bec) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:54.266794 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.268282 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.282417 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 134/266] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:53 2022] GET /identity/v3/role_assignments?user.id=2fca760624894896b4ce3fc48e430bec&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=7f519a00587a4cb38cff222d59894a29 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:54.331283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 133/267] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:54.337010 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:54.360462 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ac4a-6c3e-4581-9ac4-039bb1f52d37 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.360792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ac4a-6c3e-4581-9ac4-039bb1f52d37 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.361015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ac4a-6c3e-4581-9ac4-039bb1f52d37 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.363002 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 134/268] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:54.369052 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4320-2114-40a8-a148-d885543f25ff None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.369365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4320-2114-40a8-a148-d885543f25ff None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.369610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4320-2114-40a8-a148-d885543f25ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.393710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-bb6a4320-2114-40a8-a148-d885543f25ff None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:54.395104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-bb6a4320-2114-40a8-a148-d885543f25ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:54.427634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:54.500480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 135/269] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:54.502644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb1f97-3f4d-4946-8ab9-35be530c9bfd None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.503208 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb1f97-3f4d-4946-8ab9-35be530c9bfd None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.503931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb1f97-3f4d-4946-8ab9-35be530c9bfd None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.506084 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 136/270] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:54.512938 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.513489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.513998 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.543312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:54.544570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:54.624900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55788a79-02c2-47ea-ae97-00f7f91e82ad None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.644197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:54.722371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.722921 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.723195 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.723471 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.725882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.727388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.729303 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 135/271] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:54 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:54.739128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:54.741729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 137/272] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:54.890529 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd46b7d-edbe-4976-a43a-5bb6eb0e8222 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.938123 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.938756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.939040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.939315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.940082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] RBAC: Adding query filter params (role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=2fca760624894896b4ce3fc48e430bec) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:54.940402 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.942087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.954445 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 136/273] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:54 2022] GET /identity/v3/role_assignments?user.id=2fca760624894896b4ce3fc48e430bec&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:55.009184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:55.147903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:55.177010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daef7f-a0ce-4509-966b-9df0fac4ca00 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:55.240864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:55.241625 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.241815 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.242089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.243292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:55.245106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:55.246783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 138/274] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:55.252917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:55.270302 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:55.308344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:55.385106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322298-062f-4dd0-aef0-956c82eb34ff None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:55.400906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70857-9fab-48aa-a39a-40441c1ee297 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:55.428354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:55.429219 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.429679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.430099 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.430891 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:55.432577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:55.450738 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:55.451640 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.452424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.452694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.469653 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:55.471120 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 137/275] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 02:59:55 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:55.475520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:55.476954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:55.477845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 139/276] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:59:55.487265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:55.623933 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:55.632767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e7a50-6dea-469b-8818-760873a3eff2 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:55.687070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:55.687747 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.688204 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.688490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.689177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:55.689583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:55.692115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a08b-b36c-446e-84a1-1ec6036d0458 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:55.707080 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 138/277] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:55.713557 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:55.736580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:55.865558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd30a9-e0c2-493e-be24-a8a66a7c925a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:55.894726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44dff6-803e-457f-bd63-1d699a38486d None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.894726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44dff6-803e-457f-bd63-1d699a38486d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.894726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44dff6-803e-457f-bd63-1d699a38486d None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.895750 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 139/278] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:59:55.900247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c803c6-803a-4ef6-813c-ee7ad59a7fe9 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.900810 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c803c6-803a-4ef6-813c-ee7ad59a7fe9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.901346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c803c6-803a-4ef6-813c-ee7ad59a7fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.926102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-42c803c6-803a-4ef6-813c-ee7ad59a7fe9 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:55.928206 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-42c803c6-803a-4ef6-813c-ee7ad59a7fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:55.941961 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776dcf8-3b41-463a-b817-6d1ab5742309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:55.942572 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776dcf8-3b41-463a-b817-6d1ab5742309 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.942881 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776dcf8-3b41-463a-b817-6d1ab5742309 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.943165 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776dcf8-3b41-463a-b817-6d1ab5742309 None admin] PATH_INFO: `/v3/users/07ea93473b40458f8a6fe070fc09017b` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.963507 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776dcf8-3b41-463a-b817-6d1ab5742309 None admin] RBAC: Authorizing `identity:get_user(user_id=07ea93473b40458f8a6fe070fc09017b)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:55.965076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776dcf8-3b41-463a-b817-6d1ab5742309 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:55.966987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 140/279] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:55 2022] GET /identity/v3/users/07ea93473b40458f8a6fe070fc09017b => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:55.969235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b2f7-4a30-49cd-a648-a6b4e82633f0 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:55.969532 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b2f7-4a30-49cd-a648-a6b4e82633f0 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:55.969825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b2f7-4a30-49cd-a648-a6b4e82633f0 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:55.971074 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 141/280] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:55.976669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0b2f7-4a30-49cd-a648-a6b4e82633f0 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:56.034110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 140/281] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:56.035847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:56.036325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:56.036662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:56.059550 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:56.061125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:56.080487 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:56.121646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0b2f7-4a30-49cd-a648-a6b4e82633f0 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:56.160491 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 141/282] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:56.165107 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:56.166024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:56.166455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:56.166942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:56.167886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, user.id=07ea93473b40458f8a6fe070fc09017b, scope.system=all) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:56.168422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:56.170145 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:56.176750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 142/283] 10.222.0.78 () {56 vars in 1308 bytes} [Thu Aug 25 02:59:55 2022] GET /identity/v3/role_assignments?user.id=07ea93473b40458f8a6fe070fc09017b&scope.system=all&role.id=9dab23bd829c4bd09bc84413f424696c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:56.489488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:56.517051 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:56.556319 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:56.660894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c0e7-e66b-411b-b0cd-14389feac6b1 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:56.731755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:56.732428 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:56.732704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:56.732977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:56.748918 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c8f67-dabb-415a-b1bc-3e0f4ca056c7 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:56.756908 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:56.761912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:56.762874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:56.763944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 142/284] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:56.771623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:56.826804 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:56.828843 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:56.829597 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:56.830327 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:56.836448 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:56.859007 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:56.864270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:56.865207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:56.866026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:56.871756 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 143/285] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:56.878386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:56.916057 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:56.997787 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059ed6-1104-4b2b-abf9-7e2023834282 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.027515 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269d32-c02c-4d3d-b887-4b59aef71038 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.050672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.051650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.052142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.052595 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.053780 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:57.054304 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.056721 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.067125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 143/286] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:57.073096 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.084785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.085748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.086276 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.086736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.087675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:57.088193 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.090043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.110262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 144/287] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:57.115478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.197271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651c4eb-1c4f-4495-84d3-e68b67642fc6 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.226287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:57.238951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.239590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.239896 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.240170 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] PATH_INFO: `/v3/users/de70c0cb49734050912cbeff4259773b` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.241475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] RBAC: Authorizing `identity:get_user(user_id=de70c0cb49734050912cbeff4259773b)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.242987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.245179 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 144/288] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:57 2022] GET /identity/v3/users/de70c0cb49734050912cbeff4259773b => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:57.251288 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.264257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:57.314483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b871a61-1536-47d1-821a-9bb6077e8396 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.363682 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.364386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.364666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.365004 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] PATH_INFO: `/v3/users/6004119d123c44429c15609bcd4a0b82` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.366300 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] RBAC: Authorizing `identity:get_user(user_id=6004119d123c44429c15609bcd4a0b82)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.367883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.369927 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 145/289] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:57 2022] GET /identity/v3/users/6004119d123c44429c15609bcd4a0b82 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:59:57.377187 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.379469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd496-2b5a-464b-8f3a-c9d080906d87 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.447111 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.447785 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.448111 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.448389 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.530246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.532333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.543042 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:57.618012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5e28-7732-4d70-86be-8751c5b5ea9f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.645767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 145/290] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 02:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:57.657817 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.681887 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:57.705279 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.706529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.707107 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.707645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.710819 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.712780 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.718081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 146/291] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:57 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:57.740888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.832542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593734c-05ad-45c4-9b66-a03c415058ae None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.872439 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:57.883272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be152df-97fd-4fc7-b612-9c55b0de82f4 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:57.888766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.889415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.889696 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.889967 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.896679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.898512 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:57.900343 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 146/292] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 02:59:57 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:57.908427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:57.961986 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6448d2-ef0e-4400-96f8-f5d6341e32c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:57.962688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6448d2-ef0e-4400-96f8-f5d6341e32c3 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:57.962985 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6448d2-ef0e-4400-96f8-f5d6341e32c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:57.963246 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6448d2-ef0e-4400-96f8-f5d6341e32c3 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/6004119d123c44429c15609bcd4a0b82/roles/84492bd7932f4ac8a6582006ac6dfbd2` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:57.968934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6448d2-ef0e-4400-96f8-f5d6341e32c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c05a289ca3534ce698aab7ae7dfcc8dc, user_id=6004119d123c44429c15609bcd4a0b82, role_id=84492bd7932f4ac8a6582006ac6dfbd2)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:57.970436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6448d2-ef0e-4400-96f8-f5d6341e32c3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:58.002313 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 147/293] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 02:59:57 2022] PUT /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/users/6004119d123c44429c15609bcd4a0b82/roles/84492bd7932f4ac8a6582006ac6dfbd2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:58.080963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02627-1203-4e26-8ad0-65346be3bf26 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:58.121382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:58.122007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.122290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.122622 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:58.123519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=de70c0cb49734050912cbeff4259773b) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:58.123906 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:58.126070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45740-b656-4473-a541-94e6a06263ff None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:58.134131 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 147/294] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 02:59:57 2022] GET /identity/v3/role_assignments?user.id=de70c0cb49734050912cbeff4259773b&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:58.646953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8374-968f-429d-8806-7726ae1624c5 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.648002 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8374-968f-429d-8806-7726ae1624c5 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.648495 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8374-968f-429d-8806-7726ae1624c5 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:58.650312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 148/295] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:58.657837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e73e-9dd2-493a-a95c-571b2160b6fe None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.658697 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e73e-9dd2-493a-a95c-571b2160b6fe None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.659449 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e73e-9dd2-493a-a95c-571b2160b6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:58.683913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-a916e73e-9dd2-493a-a95c-571b2160b6fe None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:58.685543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-a916e73e-9dd2-493a-a95c-571b2160b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:58.728277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:58.776376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 148/296] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:58.953442 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2ec7-9c78-40b4-a641-69b784e82b81 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.953773 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2ec7-9c78-40b4-a641-69b784e82b81 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.953952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c2ec7-9c78-40b4-a641-69b784e82b81 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:58.955306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 149/297] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:58.961034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.961645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.962146 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:58.978658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2261ec5-b2b1-4776-89e8-9ea9d39010a2 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.979028 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2261ec5-b2b1-4776-89e8-9ea9d39010a2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.979271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2261ec5-b2b1-4776-89e8-9ea9d39010a2 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:58.980583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 150/298] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 02:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:59:58.986311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:58.988119 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:58.989440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:58.989917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:58.990406 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:59.017778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:59.018977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:59.074352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 149/299] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:59:59.082336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:59.105943 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 151/300] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 02:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:59:59.131967 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:59.259952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:59.263667 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a51c47-9a28-4aac-a2a3-079e89fe9181 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:59.313184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:59.314297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:59.314799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:59.315433 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:59.317015 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:59.319550 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:59.324084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 150/301] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 02:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:59.335855 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:59.447181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18a65-3fec-4af0-ae1a-48391d11ae6f None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:59.470376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:59.484014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:59.484633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:59.484911 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:59.485182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] PATH_INFO: `/v3/groups` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:59.486449 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:59.487350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:59.505564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 152/302] 10.222.0.78 () {60 vars in 1134 bytes} [Thu Aug 25 02:59:59 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:59.630394 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db1d5-77bc-469a-bbb9-cd03dbe1d76e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:59.660906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:59.688568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:59.689637 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:59.689949 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:59.690189 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:59.703749 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:59.708789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:59.710480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:59:59.712063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 02:59:59.715113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 151/303] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:59:59.716246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:59.743022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:59.759250 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:59.833972 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac252036-71e9-4091-8f33-43337d888dcc None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:59.883460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:59.884535 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:59.885071 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:59.885546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:59.903839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:59:59.905767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c56c23-fa2a-4b12-9284-a291cb07d49e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:59:59.911264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:59:59.912299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:59:59.913128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 02:59:59.913813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 153/304] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 02:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:59:59.925421 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:59.962043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:59.963049 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:59.963656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:59.964178 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:59.965069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:59.965699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:59.967583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:59.978244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 152/305] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:59.985409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:00.080519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2927-07d5-451f-9406-ec681493c8bf None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:00.082187 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:00.094862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:00.106778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b753f-53dc-434c-afaa-9ac56f9f2458 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:00.124055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:00.125002 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.125285 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.125560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.126233 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:00.126536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:00.127945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:00.139040 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 154/306] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 02:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:00.147920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:00.150000 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:00.151296 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.151947 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.152558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] PATH_INFO: `/v3/users/a290b15708d94e0cbf1fb6d36af89577` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.180199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] RBAC: Authorizing `identity:get_user(user_id=a290b15708d94e0cbf1fb6d36af89577)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:00.182244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:00.184541 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 153/307] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 02:59:59 2022] GET /identity/v3/users/a290b15708d94e0cbf1fb6d36af89577 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:00.193614 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:00.299955 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2100c8-f5a3-47b3-b1d2-c51395789a24 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:00.317113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90feb6-446e-4328-b2a5-36d816d51c59 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:00.339751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:00.340421 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.340701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.340973 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] PATH_INFO: `/v3/users/07ea93473b40458f8a6fe070fc09017b` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.342196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] RBAC: Authorizing `identity:get_user(user_id=07ea93473b40458f8a6fe070fc09017b)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:00.344038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:00.351501 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 155/308] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 03:00:00 2022] GET /identity/v3/users/07ea93473b40458f8a6fe070fc09017b => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:00.353635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:00.367195 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:00.368287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.369120 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.369638 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.370633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] RBAC: Adding query filter params (role.id=84492bd7932f4ac8a6582006ac6dfbd2, user.id=a290b15708d94e0cbf1fb6d36af89577, scope.system=all) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:00.371203 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:00.373261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faca4-929c-4c67-acd0-322eef3c0422 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:00.380247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 154/309] 10.222.0.78 () {56 vars in 1308 bytes} [Thu Aug 25 03:00:00 2022] GET /identity/v3/role_assignments?user.id=a290b15708d94e0cbf1fb6d36af89577&scope.system=all&role.id=84492bd7932f4ac8a6582006ac6dfbd2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:00.400872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:00.500381 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09f6dd-2d39-4415-9f22-1307a1e55c99 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:00.529150 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374a0e3-806c-46e4-992a-ccd647eba7ed None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.529430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374a0e3-806c-46e4-992a-ccd647eba7ed None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.529691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374a0e3-806c-46e4-992a-ccd647eba7ed None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.531564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 155/310] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:00.537412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.537713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.537964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.554412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:00.555220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.555566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.555942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] PATH_INFO: `/v3/system/users/07ea93473b40458f8a6fe070fc09017b/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.557784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=07ea93473b40458f8a6fe070fc09017b, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:00.557997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:00.559189 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:00.559304 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:00.573662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:00.576734 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 156/311] 10.222.0.78 () {58 vars in 1334 bytes} [Thu Aug 25 03:00:00 2022] PUT /identity/v3/system/users/07ea93473b40458f8a6fe070fc09017b/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:00.660025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 156/312] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:01.012346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:01.113561 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:01.121090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fb89d-2825-4d7d-8e88-166a8d0a057f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:01.158424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:01.159082 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:01.159361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:01.159636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:01.171474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:01.176375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:01.178053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:01.179697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 157/313] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:01.185454 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:01.295643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516260a-44d3-415e-9dc8-3d9cca063fa2 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:01.338294 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:01.338907 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:01.339187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:01.339453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:01.340163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:01.340467 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:01.341906 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:01.351450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 157/314] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:01.356920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:01.514093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006df7e-5eed-4a0c-a532-a91e21156e22 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:01.558786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:01.559346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:01.559687 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:01.560041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] PATH_INFO: `/v3/users/6004119d123c44429c15609bcd4a0b82` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:01.561295 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] RBAC: Authorizing `identity:get_user(user_id=6004119d123c44429c15609bcd4a0b82)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:01.563299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:01.565120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 158/315] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 03:00:01 2022] GET /identity/v3/users/6004119d123c44429c15609bcd4a0b82 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:01.570538 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:01.575499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:01.714703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81611-ea08-41bb-9e99-bb8b743e6b83 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:01.759077 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:01.759709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:01.760026 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:01.760305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:01.850003 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:01.851558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:01.855008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:01.988914 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 158/316] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:01.995219 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:02.028274 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:02.119710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a77d-1a6f-446e-bd21-e12e379778ff None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:02.164445 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a41b-9056-4cfe-b43b-bab189c21bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:02.165096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a41b-9056-4cfe-b43b-bab189c21bd4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:02.165380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a41b-9056-4cfe-b43b-bab189c21bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:02.165656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a41b-9056-4cfe-b43b-bab189c21bd4 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:02.166965 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a41b-9056-4cfe-b43b-bab189c21bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:02.168732 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a41b-9056-4cfe-b43b-bab189c21bd4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:02.173681 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 159/317] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:01 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:02.182290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:02.261155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e568f2-4a6c-4caa-9611-495e70c72662 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:02.261791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e568f2-4a6c-4caa-9611-495e70c72662 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:02.262296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e568f2-4a6c-4caa-9611-495e70c72662 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:02.264229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 160/318] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:02.270398 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:02.270989 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:02.271470 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:02.291787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:02.293579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:02.316235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed81e0-4fc8-423d-b364-d303cb5916f5 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:02.323667 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:02.372553 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:02.373175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:02.373535 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:02.374011 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:02.375255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] RBAC: Adding query filter params (role.id=84492bd7932f4ac8a6582006ac6dfbd2, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc, user.id=6004119d123c44429c15609bcd4a0b82) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:02.375691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:02.377188 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:02.383587 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 161/319] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:02.399876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 159/320] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:02 2022] GET /identity/v3/role_assignments?user.id=6004119d123c44429c15609bcd4a0b82&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=84492bd7932f4ac8a6582006ac6dfbd2 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:02.826875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:02.973110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf0e3-99fa-4aaf-a6ca-6bb7a13e8292 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:03.024340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730246c5-6a6c-4cc8-a7c8-9882412eaea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:03.024980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730246c5-6a6c-4cc8-a7c8-9882412eaea4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.025270 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730246c5-6a6c-4cc8-a7c8-9882412eaea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.025547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730246c5-6a6c-4cc8-a7c8-9882412eaea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.026662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730246c5-6a6c-4cc8-a7c8-9882412eaea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:03.028157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730246c5-6a6c-4cc8-a7c8-9882412eaea4 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:03.030050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 160/321] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:03.036768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:03.044902 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0cab-ded7-4cf6-8f6f-ee594ce3a033 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.044902 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0cab-ded7-4cf6-8f6f-ee594ce3a033 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.045185 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0cab-ded7-4cf6-8f6f-ee594ce3a033 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.047552 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 161/322] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:03.052887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa36-264e-49a1-b9b6-1481ab022337 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.053282 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa36-264e-49a1-b9b6-1481ab022337 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.053497 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3efa36-264e-49a1-b9b6-1481ab022337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.073485 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:03.074046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8a3efa36-264e-49a1-b9b6-1481ab022337 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:03.075865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8a3efa36-264e-49a1-b9b6-1481ab022337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:03.115677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:03.161151 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d954c0-fc4d-4912-9415-842a1d3c734b None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:03.161643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 162/323] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:03.162887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fc81a-635a-46f9-9bf0-1ee272d2a2b8 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.163171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fc81a-635a-46f9-9bf0-1ee272d2a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.163444 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fc81a-635a-46f9-9bf0-1ee272d2a2b8 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.164736 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 163/324] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:03.170365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.170636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.170888 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.194365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:03.196098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:03.222212 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:03.222937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.223223 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.223499 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] PATH_INFO: `/v3/groups` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.224177 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:03.225660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:03.259844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 162/325] 10.222.0.78 () {60 vars in 1134 bytes} [Thu Aug 25 03:00:03 2022] POST /identity/v3/groups => generated 226 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:00:03.334772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 164/326] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:03.520795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:03.630645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:03.668397 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f5fb-c6e5-457f-9d20-995ddaa5ade6 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:03.685574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:03.731626 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:03.732256 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.732536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.734685 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.749323 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:03.759311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:03.760307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:03.761832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 163/327] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:03.769193 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:03.844326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:03.856647 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af4e21-87a1-419a-b211-058edfba3c61 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:03.910851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:03.911880 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.912459 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.913019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.926235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578278-9882-4aee-a43c-e09615d68ee8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:03.929185 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:03.939854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:03.940962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 03:00:03.941760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:03.944924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 165/328] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:03.950684 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:03.966563 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:03.967190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:03.967463 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:03.967729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:03.968492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:03.968794 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:03.970196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:03.981198 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 164/329] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:03.988136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:03.992992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:04.154991 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576a83-806c-480d-9485-084cdcba2dba None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:04.169641 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18da04-c3ef-40b2-a6ee-da679fc75f4a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:04.208100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:04.209292 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:04.210019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:04.210628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:04.212012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:04.212690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:04.215649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:04.221378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:04.222173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:04.222622 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:04.222999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] PATH_INFO: `/v3/users/07ea93473b40458f8a6fe070fc09017b` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:04.224344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] RBAC: Authorizing `identity:get_user(user_id=07ea93473b40458f8a6fe070fc09017b)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:04.225945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:04.228292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 165/330] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 03:00:03 2022] GET /identity/v3/users/07ea93473b40458f8a6fe070fc09017b => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:04.230976 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 166/331] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:04.235479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:04.244202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:04.284216 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:04.334216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:04.380960 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91097029-9f7c-467f-95c5-693eb8ec170f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:04.433679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613bd2b-b6e7-488c-b099-1ab2cb5e1612 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:04.469533 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:04.470166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:04.470447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:04.470721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:04.471468 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] RBAC: Adding query filter params (role.id=9dab23bd829c4bd09bc84413f424696c, user.id=07ea93473b40458f8a6fe070fc09017b, scope.system=all) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:04.471779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:04.473335 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:04.487913 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 166/332] 10.222.0.78 () {56 vars in 1308 bytes} [Thu Aug 25 03:00:04 2022] GET /identity/v3/role_assignments?user.id=07ea93473b40458f8a6fe070fc09017b&scope.system=all&role.id=9dab23bd829c4bd09bc84413f424696c => generated 510 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:04.518114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fbb96-e0c2-4414-913b-d4df65658a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:04.519026 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbb96-e0c2-4414-913b-d4df65658a4b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:04.519501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbb96-e0c2-4414-913b-d4df65658a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:04.519949 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbb96-e0c2-4414-913b-d4df65658a4b None admin] PATH_INFO: `/v3/users/a290b15708d94e0cbf1fb6d36af89577` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:04.524788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fbb96-e0c2-4414-913b-d4df65658a4b None admin] RBAC: Authorizing `identity:get_user(user_id=a290b15708d94e0cbf1fb6d36af89577)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:04.526525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fbb96-e0c2-4414-913b-d4df65658a4b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:04.528438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 167/333] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 03:00:04 2022] GET /identity/v3/users/a290b15708d94e0cbf1fb6d36af89577 => generated 293 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:04.535336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:04.711638 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8edfe-87ff-470e-a911-e082e18a5187 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:04.775141 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:04.785227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1fce9-a794-42c7-b2c9-3a89d38051c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:04.785917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1fce9-a794-42c7-b2c9-3a89d38051c3 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:04.786200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1fce9-a794-42c7-b2c9-3a89d38051c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:04.786504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1fce9-a794-42c7-b2c9-3a89d38051c3 None admin] PATH_INFO: `/v3/system/users/a290b15708d94e0cbf1fb6d36af89577/roles/84492bd7932f4ac8a6582006ac6dfbd2` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:04.793309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1fce9-a794-42c7-b2c9-3a89d38051c3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a290b15708d94e0cbf1fb6d36af89577, role_id=84492bd7932f4ac8a6582006ac6dfbd2)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:04.795493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1fce9-a794-42c7-b2c9-3a89d38051c3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:04.807641 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 167/334] 10.222.0.78 () {58 vars in 1334 bytes} [Thu Aug 25 03:00:04 2022] PUT /identity/v3/system/users/a290b15708d94e0cbf1fb6d36af89577/roles/84492bd7932f4ac8a6582006ac6dfbd2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:06.337420 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25893-74d9-471d-b598-58fcb87ec500 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:06.338473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25893-74d9-471d-b598-58fcb87ec500 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:06.338955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25893-74d9-471d-b598-58fcb87ec500 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:06.341003 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 168/335] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:06.348408 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f444548-e51f-4f45-967f-6d31c35273ee None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:06.348944 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f444548-e51f-4f45-967f-6d31c35273ee None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:06.349254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f444548-e51f-4f45-967f-6d31c35273ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:06.372440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-9f444548-e51f-4f45-967f-6d31c35273ee None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:06.373661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-9f444548-e51f-4f45-967f-6d31c35273ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:06.471318 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 168/336] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:07.124694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3519da9-4eac-4ae1-ba72-c4e460a3fca0 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:07.124978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3519da9-4eac-4ae1-ba72-c4e460a3fca0 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:07.125339 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3519da9-4eac-4ae1-ba72-c4e460a3fca0 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:07.126923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 169/337] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:07.132292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b0cf-1de6-411a-a168-7571c473fd0e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:07.132637 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b0cf-1de6-411a-a168-7571c473fd0e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:07.132875 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b0cf-1de6-411a-a168-7571c473fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:07.156669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-00f9b0cf-1de6-411a-a168-7571c473fd0e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:07.158057 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-00f9b0cf-1de6-411a-a168-7571c473fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:07.250203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 169/338] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:07.397093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7f2d9-7e6b-441b-a05b-ecaead6357ae None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:07.397594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7f2d9-7e6b-441b-a05b-ecaead6357ae None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:07.397594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7f2d9-7e6b-441b-a05b-ecaead6357ae None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:07.399149 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 170/339] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:07.405047 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:07.406027 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:07.406205 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:07.425886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:07.427094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:07.483098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:07.509496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 170/340] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:07.538050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7f2d9-7e6b-441b-a05b-ecaead6357ae None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:07.636596 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:07.656591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7f2d9-7e6b-441b-a05b-ecaead6357ae None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:07.704532 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:07.705458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:07.705900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:07.706330 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:07.720778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:07.725758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:07.726901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:07.727974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:07.730926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 171/341] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:07.736699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:07.926974 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c6c7-dd3b-470c-9117-cd3032694d79 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:07.951005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:07.996816 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:07.997774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:07.998284 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:07.998729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.000375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:08.000863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:08.003937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:08.020478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 171/342] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:08.028607 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:08.127781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:08.166202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944ce47-8b4b-452a-b11f-bdd3fb040e4e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:08.209743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027146d8-d984-4c04-94a4-bc9517381be9 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:08.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:08.224561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.225243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.225681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.241812 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:08.249709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:08.251403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:08.252407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:08.254624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 172/343] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:08.255798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:08.256474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dbc21-ab1f-44c8-9134-371a6095b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:08.257207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dbc21-ab1f-44c8-9134-371a6095b4fb None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.257578 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dbc21-ab1f-44c8-9134-371a6095b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.258010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dbc21-ab1f-44c8-9134-371a6095b4fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.269041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:08.356378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dbc21-ab1f-44c8-9134-371a6095b4fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:08.357807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dbc21-ab1f-44c8-9134-371a6095b4fb None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:08.412824 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd54965-6108-4c0e-8b7c-953dd3f7ba2f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:08.422572 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:08.481328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1f9a8-2fed-48fe-88e4-bcd4ed14cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:08.483104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f9a8-2fed-48fe-88e4-bcd4ed14cb5b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.483980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f9a8-2fed-48fe-88e4-bcd4ed14cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.484255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1f9a8-2fed-48fe-88e4-bcd4ed14cb5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.498731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1f9a8-2fed-48fe-88e4-bcd4ed14cb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1bf1f9a8-2fed-48fe-88e4-bcd4ed14cb5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:08.506674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:08.511952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 173/344] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:00:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:08.513404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d11ba6-c532-4726-b3c8-534f2229a3cd None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.514816 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d11ba6-c532-4726-b3c8-534f2229a3cd None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.514816 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d11ba6-c532-4726-b3c8-534f2229a3cd None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.514816 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 174/345] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:08.514816 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d11ba6-c532-4726-b3c8-534f2229a3cd None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:08.547100 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 172/346] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:08.552662 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.553020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.553264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.574987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:08.576243 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:08.649586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:08.694833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 173/347] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:08.700939 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:08.724513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d11ba6-c532-4726-b3c8-534f2229a3cd None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:08.820323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:08.821376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.821887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.822366 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.823253 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:08.823773 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:08.825440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:08.844137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 175/348] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:08.845504 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:08.853226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:08.892335 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a275e0-7979-4008-a918-5a3bae286c14 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:08.950239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:08.950947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:08.951317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:08.952152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:08.952892 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:08.953201 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:08.954602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:08.965883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 174/349] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:08.967111 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.032772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056f894-f4fb-4457-a949-cc18a7f71679 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.063397 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.072129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a9eef-f648-4bdc-bf20-ded985243e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.072129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9eef-f648-4bdc-bf20-ded985243e13 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.072129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9eef-f648-4bdc-bf20-ded985243e13 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.072129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9eef-f648-4bdc-bf20-ded985243e13 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.072766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9eef-f648-4bdc-bf20-ded985243e13 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:09.074289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9eef-f648-4bdc-bf20-ded985243e13 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:09.075952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 176/350] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:08 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:09.077770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5ffa-dc4e-4e38-9e2e-fad1cf97c012 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.078054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5ffa-dc4e-4e38-9e2e-fad1cf97c012 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.078324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba5ffa-dc4e-4e38-9e2e-fad1cf97c012 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.079763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 177/351] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:09.080346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba5ffa-dc4e-4e38-9e2e-fad1cf97c012 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.143478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f76e19-661a-4e11-808a-919ee6c3ffff None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.185994 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee47f0f-425d-47c4-9c8e-7175261ca9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.186458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee47f0f-425d-47c4-9c8e-7175261ca9e1 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.186736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee47f0f-425d-47c4-9c8e-7175261ca9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.187008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee47f0f-425d-47c4-9c8e-7175261ca9e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.198548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.204263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba5ffa-dc4e-4e38-9e2e-fad1cf97c012 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.248934 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.249544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.249821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.250087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.272928 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee47f0f-425d-47c4-9c8e-7175261ca9e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:09.274381 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee47f0f-425d-47c4-9c8e-7175261ca9e1 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:09.332558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.342644 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:09.344721 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:09.428780 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 175/352] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:09.430054 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175492-52a6-4d8b-9913-73d93fe0d6e1 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.430342 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175492-52a6-4d8b-9913-73d93fe0d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.430617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175492-52a6-4d8b-9913-73d93fe0d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.451649 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a4175492-52a6-4d8b-9913-73d93fe0d6e1 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:09.453148 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a4175492-52a6-4d8b-9913-73d93fe0d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:09.484585 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 178/353] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:09.486106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.491636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.539497 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 176/354] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:09.541181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929ed4b-5acd-4369-9051-1f4c1f704a0d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.541645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929ed4b-5acd-4369-9051-1f4c1f704a0d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.541915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929ed4b-5acd-4369-9051-1f4c1f704a0d None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.543399 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 177/355] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:09.543980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929ed4b-5acd-4369-9051-1f4c1f704a0d None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.603424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.611564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0b1e-9a6a-43c5-9d70-f1fc21878167 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.650186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.651158 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.651437 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.651705 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.660868 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:09.662328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:09.664319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 179/356] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:09.665176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.680832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929ed4b-5acd-4369-9051-1f4c1f704a0d None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.735281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.736993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.736993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.736993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.755268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:09.761013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:09.762021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 03:00:09.762907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:09.766035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 178/357] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:09.767164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.803638 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a76b-c7d1-4607-8416-cb282929a6ba None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.811357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.847548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f48727-556a-48e1-896e-3d36b8e6d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.848628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f48727-556a-48e1-896e-3d36b8e6d778 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.848983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f48727-556a-48e1-896e-3d36b8e6d778 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.849331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f48727-556a-48e1-896e-3d36b8e6d778 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.851764 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f48727-556a-48e1-896e-3d36b8e6d778 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:09.853994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f48727-556a-48e1-896e-3d36b8e6d778 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:09.855214 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 180/358] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:09.861189 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.861483 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.861763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.882044 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:09.883258 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:09.908482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:09.912870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1fb7-645d-4603-a4fc-0934cb4e315e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:09.955793 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:09.956892 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:09.957176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:09.957445 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:09.958733 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:09.960083 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:09.962868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 179/359] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:09.963671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 181/360] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:09.963798 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:09.964585 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.101781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:10.110509 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fdabf-1421-4537-8327-324bfd4ca7c4 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.123901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387bfb-a46c-4a08-9b77-3ad5f35b2036 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.160523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.161131 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.161407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.161675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.162395 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:10.162731 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.164155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.170459 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 180/361] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.171665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.180737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.181366 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.181694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.181980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.183446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:10.183779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.185641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.196842 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 182/362] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.197707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.225155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:10.298461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c79d4-7428-40ad-a0c6-52a14dadb90e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.317209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed1d32-fbf8-4d53-8a0b-414eb7e58735 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.340593 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.341071 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.341356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.341633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.343678 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.345203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.346912 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 181/363] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.347633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.364926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.365490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.365767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.366037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.380574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:10.386201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:10.387187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 183/364] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:10.388369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.403718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:10.502089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530bb1b-321f-4779-8326-f772aa41ea2c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.537953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:10.558026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.558676 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.558958 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.559229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.560480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.562600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.564470 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 182/365] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.565091 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.569008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f90c-6e0e-43f9-bf74-c7061d04284f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.628619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.629799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.630618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.631108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] PATH_INFO: `/v3/users/a290b15708d94e0cbf1fb6d36af89577` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.632677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] RBAC: Authorizing `identity:get_user(user_id=a290b15708d94e0cbf1fb6d36af89577)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.634918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.637658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 184/366] 10.222.0.78 () {56 vars in 1177 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/users/a290b15708d94e0cbf1fb6d36af89577 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.638749 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.690612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:10.700567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd392-cf74-483e-a771-a9762b00afde None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.760961 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.762096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.762581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.763481 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.782417 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:10.789866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:10.790828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:10.791677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 183/367] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:10.792946 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.804035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0850712-4815-42bb-9a50-f3003eaf1a82 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.851593 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.852247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.852538 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.854086 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.854086 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:10.854086 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.855252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.862889 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 185/368] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.864203 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:10.883864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:10.937875 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7091b8e-1b3a-4217-9487-567273d39617 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.981257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:10.982160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:10.982593 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:10.983018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:10.984469 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:10.984960 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:10.986556 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:10.992352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713450-0d4d-4425-b6cc-657d6649dd66 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:10.997090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 184/369] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:10.998298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:11.023531 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:11.037763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:11.038395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:11.038814 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:11.039174 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:11.040040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:11.040372 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:11.041983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:11.054899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 186/370] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:11.055865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:11.140390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2309522-fc63-47d7-9e20-96c27000926d None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:11.178417 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:11.192317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:11.192940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:11.193220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:11.193492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:11.194234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] RBAC: Adding query filter params (role.id=84492bd7932f4ac8a6582006ac6dfbd2, user.id=a290b15708d94e0cbf1fb6d36af89577, scope.system=all) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:11.194541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:11.196038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:11.215933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 185/371] 10.222.0.78 () {56 vars in 1308 bytes} [Thu Aug 25 03:00:10 2022] GET /identity/v3/role_assignments?user.id=a290b15708d94e0cbf1fb6d36af89577&scope.system=all&role.id=84492bd7932f4ac8a6582006ac6dfbd2 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:11.215933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:11.220187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd24e6-b273-4200-9baa-d0baac3d3781 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:11.272756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:11.273760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:11.274144 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:11.274423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:11.275193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:11.275507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:11.277012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:11.289361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 187/372] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:11.295887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:11.436789 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:11.468093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca1579-6ae5-49a2-9acc-0ca3c9f9c793 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:11.503364 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:11.504058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:11.504286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:11.504560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:11.523602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f8c3-2cd9-45a7-b55f-799f7aed7bec None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:11.571892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:11.572680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:11.572959 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:11.573232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:11.596199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:11.644675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:11.646243 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:11.710273 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:11.711675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:11.794541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:11.850912 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 186/373] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:11.857964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:11.901346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 188/374] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:11.933371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:11.992322 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:12.070419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547b374-a5ab-4362-9f59-692bae57cff1 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:12.079745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4db0-e035-49d8-bf71-725b1b870683 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:12.139285 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:12.140010 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.140351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.140630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] PATH_INFO: `/v3/projects/7ada4f5619714b09af4deed40278da87` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.144336 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] RBAC: Authorizing `identity:get_project(project_id=7ada4f5619714b09af4deed40278da87)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:12.145849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:12.147946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 189/375] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:11 2022] GET /identity/v3/projects/7ada4f5619714b09af4deed40278da87 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:12.153464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:12.159035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:12.159688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.160017 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.160295 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.161677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:12.165751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:12.177373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 187/376] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:11 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:12.189825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:12.260809 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:12.327753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cfda9-6f52-443b-b6dc-f342d8b02c93 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:12.386016 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:12.387038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.387867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.390114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.391580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:12.393334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:12.395993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 188/377] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:12 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:12.401835 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:12.404440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069fe1-1795-4e42-8166-9cbe43b872d0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:12.424187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:12.480584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:12.481301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.481586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.481860 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] PATH_INFO: `/v3/groups/237e796cc837412ba36b30906e299559` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.491314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] RBAC: Authorizing `identity:get_group(group_id=237e796cc837412ba36b30906e299559)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:12.492819 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:12.494719 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 190/378] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:12 2022] GET /identity/v3/groups/237e796cc837412ba36b30906e299559 => generated 229 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:12.501548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:12.607201 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623d156-f9dc-4c83-b9b5-fa2fca12eb1f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:12.630756 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:12.676838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:12.677474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.677760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.678038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.678789 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:12.679104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:12.680610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605eab9-0d91-423e-b3c4-85414d62d3f7 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:12.692635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 189/379] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:12 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:12.695526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee03e48-9d72-401a-971b-8ffd4e92f63d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:12.738229 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:12.738850 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.739133 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.739410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.740186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] RBAC: Adding query filter params (group.id=237e796cc837412ba36b30906e299559, role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=7ada4f5619714b09af4deed40278da87) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:12.740495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:12.741972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daac32-994f-4ab7-8f54-5a9b1d19d10c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:12.749707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 191/380] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:12 2022] GET /identity/v3/role_assignments?group.id=237e796cc837412ba36b30906e299559&scope.project.id=7ada4f5619714b09af4deed40278da87&role.id=7f519a00587a4cb38cff222d59894a29 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:12.930240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4449360-a80e-4db3-adab-2bc28b6d47e6 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.930560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4449360-a80e-4db3-adab-2bc28b6d47e6 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.930724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4449360-a80e-4db3-adab-2bc28b6d47e6 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.932515 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 190/381] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:12.942977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72583cac-00ad-4f17-9984-ea4ef254038e None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:12.943387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72583cac-00ad-4f17-9984-ea4ef254038e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:12.943551 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72583cac-00ad-4f17-9984-ea4ef254038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:12.969289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-72583cac-00ad-4f17-9984-ea4ef254038e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:12.970806 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-72583cac-00ad-4f17-9984-ea4ef254038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:13.008602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:13.053293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 192/382] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:13.585602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4449360-a80e-4db3-adab-2bc28b6d47e6 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:13.661388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0bbc7-4dc4-4f34-bc98-97aae9fad06b None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:13.661704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0bbc7-4dc4-4f34-bc98-97aae9fad06b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:13.661957 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0bbc7-4dc4-4f34-bc98-97aae9fad06b None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:13.663677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 193/383] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:13.673147 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:13.673439 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:13.673714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:13.700914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4449360-a80e-4db3-adab-2bc28b6d47e6 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:13.708780 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:13.709972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:13.753900 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:13.755064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:13.755566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:13.756157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:13.776580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:13.782516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:13.783431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:13.784273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:13.787986 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 191/384] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:13.802841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:13.856905 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 194/385] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:13.868635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:13.961638 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a445-3ac9-448c-a609-c8620f0c6876 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.017539 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.018184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.018450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.018722 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.019393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:14.019700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:14.021113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e5b1f-fbab-46d3-9f8f-ab2e44bc4b75 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:14.036136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 192/386] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:14.041563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.046785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30465dab-0ec5-4794-8614-0cf6c09fdbdb None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.047069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30465dab-0ec5-4794-8614-0cf6c09fdbdb None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.047349 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30465dab-0ec5-4794-8614-0cf6c09fdbdb None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.048976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 193/387] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:14.054194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.054480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.054757 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.090619 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:14.093058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:14.200297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:14.212955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b448-527a-4877-bd8a-4184ff870736 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.224197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 194/388] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:14.270816 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.272213 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.272928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.273495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.280177 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.281469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:14.284136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:14.286987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 195/389] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:14.295533 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.330483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:14.433136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab757cce-e8c6-4d24-8f18-32aee1abb10c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.476239 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.476785 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.477063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.477336 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.478856 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:14.480319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:14.482086 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 196/390] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:14.488311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.518905 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917d7e4-80d3-42c0-b380-5e258bf9bfd8 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.531375 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:14.586851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.587490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.587768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.588063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.612657 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:14.618737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:14.619617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:14.620466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 195/391] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:14.627858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.669779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba7a8-db70-432e-8808-b97cfffba2c1 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.708548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.709227 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.709758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.709758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.711739 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4eb447cdf07f48efaf2af44b4af271dc, group_id=712a754f37d849d28f4df6f3f237a7fd, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:14.713252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:14.734383 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 197/392] 10.222.0.78 () {58 vars in 1442 bytes} [Thu Aug 25 03:00:14 2022] PUT /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:14.736398 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.784057 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:14.834198 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5ce36-79c2-4637-bf53-d0bd00eaf2ba None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.872045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:14.888531 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40feea-e335-4ad9-b834-10e311b875f8 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:14.935289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.936527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.937020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.937520 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.949414 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:14.950056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:14.950335 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:14.950604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:14.951289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:14.951660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:14.953131 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:14.953467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:14.959084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:14.960103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:14.960912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:14.964435 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 198/393] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:14.971800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:14.978285 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 196/394] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:14.985645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.105605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eaa5b-e6c6-4532-b921-e94967de08c4 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.106587 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b670-952a-4b77-b2fd-51e9afbcf9d0 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.148434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.149041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.149317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.149584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.150243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:15.150542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.152148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.162856 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 199/395] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:15.170130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.184343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.185343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.185821 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.186833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.189240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.190901 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.194664 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 197/396] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:14 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:15.200575 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:15.200831 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.233412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:15.384069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb990b-fbc8-4a07-866f-e253cf6aa737 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.407780 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0de0-4b8f-4781-8dae-b9e7ff59b497 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.465554 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63912d-d1ff-4388-b927-7c1568dbdd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.467091 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63912d-d1ff-4388-b927-7c1568dbdd08 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.468227 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63912d-d1ff-4388-b927-7c1568dbdd08 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.468808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63912d-d1ff-4388-b927-7c1568dbdd08 None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.470267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63912d-d1ff-4388-b927-7c1568dbdd08 None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.472456 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63912d-d1ff-4388-b927-7c1568dbdd08 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.474501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 200/397] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:15 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:15.475685 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.480248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.480248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.480248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.480475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4ab9-4f8c-44ca-9d6f-27e55470e22b None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.480560 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4ab9-4f8c-44ca-9d6f-27e55470e22b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.480773 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f4ab9-4f8c-44ca-9d6f-27e55470e22b None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.482197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 201/398] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:15.487267 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.488048 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4ab9-4f8c-44ca-9d6f-27e55470e22b None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.488781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.495672 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 198/399] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:15 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:15.497099 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.596882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:15.601035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:15.618958 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78158249-64ea-471d-b617-a8265e67e4cd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.620727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f4ab9-4f8c-44ca-9d6f-27e55470e22b None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.657983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2615127-7f99-45f1-9746-5acbca46109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.658952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615127-7f99-45f1-9746-5acbca46109d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.659235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615127-7f99-45f1-9746-5acbca46109d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.659520 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615127-7f99-45f1-9746-5acbca46109d None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.660798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2615127-7f99-45f1-9746-5acbca46109d None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.662237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2615127-7f99-45f1-9746-5acbca46109d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.663862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 202/400] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:15 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:15.665046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17065c-82cb-4937-b548-39c009fdc42c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.665335 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17065c-82cb-4937-b548-39c009fdc42c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.665610 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17065c-82cb-4937-b548-39c009fdc42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.670112 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9d619-a3b1-4ab0-a57c-2562185d8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.674923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9d619-a3b1-4ab0-a57c-2562185d8cd2 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.674923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9d619-a3b1-4ab0-a57c-2562185d8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.674923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9d619-a3b1-4ab0-a57c-2562185d8cd2 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.678990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9d619-a3b1-4ab0-a57c-2562185d8cd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c05a289ca3534ce698aab7ae7dfcc8dc, group_id=712a754f37d849d28f4df6f3f237a7fd, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.682106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9d619-a3b1-4ab0-a57c-2562185d8cd2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.685727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8e17065c-82cb-4937-b548-39c009fdc42c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:15.687008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8e17065c-82cb-4937-b548-39c009fdc42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:15.697237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 199/401] 10.222.0.78 () {58 vars in 1442 bytes} [Thu Aug 25 03:00:15 2022] PUT /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:15.698991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590c5c5-7344-4b39-8bfc-598692eac483 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.699488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590c5c5-7344-4b39-8bfc-598692eac483 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.700024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590c5c5-7344-4b39-8bfc-598692eac483 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.701953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 200/402] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:15.702966 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590c5c5-7344-4b39-8bfc-598692eac483 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.779608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 203/403] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:15.781747 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.782185 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.782679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.805276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:15.806540 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:15.845026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590c5c5-7344-4b39-8bfc-598692eac483 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.881623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 204/404] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:15.890700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.891615 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.892128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.892658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/528407bf4d38459a97d4e921cd7f7123` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.895188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] RBAC: Authorizing `identity:create_grant(project_id=4eb447cdf07f48efaf2af44b4af271dc, group_id=712a754f37d849d28f4df6f3f237a7fd, role_id=528407bf4d38459a97d4e921cd7f7123)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.896945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.916077 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 201/405] 10.222.0.78 () {58 vars in 1442 bytes} [Thu Aug 25 03:00:15 2022] PUT /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/528407bf4d38459a97d4e921cd7f7123 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:16.191540 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.203520 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:16.275419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.286853 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:16.302795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e3fb-ae76-4b43-a1e7-e771a2b2b0e9 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.341836 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:16.342509 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:16.342789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:16.343062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:16.354325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:16.359434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:16.360407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:16.361209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 205/406] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:16.366825 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.392474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d79e1-ca66-47bc-a14c-3d81b099d10c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.427288 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:16.428133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:16.428787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:16.429076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:16.440240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:16.443374 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:16.450306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:16.451229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:16.452658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 202/407] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:16.458261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.479765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4504a0-9d6d-4fcc-8296-625d5b3d8438 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.518098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:16.518883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:16.519377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:16.520000 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:16.520764 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:16.521203 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:16.522662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:16.532650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 206/408] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:16.538157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.571454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:16.646240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580b5b-c26b-4686-82da-a61489ad54e9 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.687094 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8eff9-0b26-4f32-9d08-96201199c4fd None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.707613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:16.708345 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:16.708821 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:16.709637 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:16.710108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:16.710517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:16.712020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:16.724727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:16.730651 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:16.732888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 203/409] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:16.733285 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:16.733966 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:16.734427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:16.736001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:16.738250 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.742071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:16.745280 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 207/410] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:16.754682 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:16.938496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3197ece-d42c-4b44-8543-875feeb40f0a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.954182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fc903-779a-474b-9c1c-e5d9f6a23c16 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:16.977375 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:16.978420 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:16.978847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:16.979263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:16.980563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:16.982629 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:16.985882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 208/411] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:16.992167 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:17.045116 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:17.067736 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:17.084520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.085169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.085450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.085727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] PATH_INFO: `/v3/groups/237e796cc837412ba36b30906e299559` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.093034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] RBAC: Authorizing `identity:get_group(group_id=237e796cc837412ba36b30906e299559)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.094477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.096248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 204/412] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:16 2022] GET /identity/v3/groups/237e796cc837412ba36b30906e299559 => generated 229 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:17.103355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a485384-886f-4ab9-bd89-6f30c31385fe None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:17.103501 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:17.141323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.141987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.142269 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.142547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/528407bf4d38459a97d4e921cd7f7123` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.144901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c05a289ca3534ce698aab7ae7dfcc8dc, group_id=712a754f37d849d28f4df6f3f237a7fd, role_id=528407bf4d38459a97d4e921cd7f7123)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.146424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.173996 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 209/413] 10.222.0.78 () {58 vars in 1442 bytes} [Thu Aug 25 03:00:16 2022] PUT /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc/groups/712a754f37d849d28f4df6f3f237a7fd/roles/528407bf4d38459a97d4e921cd7f7123 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:17.260112 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0427dbe-ec2e-43d5-b608-2587386de327 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:17.303147 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c9d9-a0c6-4f52-9714-9b2ca7b21bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.303799 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c9d9-a0c6-4f52-9714-9b2ca7b21bac None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.304194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c9d9-a0c6-4f52-9714-9b2ca7b21bac None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.304483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c9d9-a0c6-4f52-9714-9b2ca7b21bac None admin] PATH_INFO: `/v3/projects/7ada4f5619714b09af4deed40278da87` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.305694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c9d9-a0c6-4f52-9714-9b2ca7b21bac None admin] RBAC: Authorizing `identity:get_project(project_id=7ada4f5619714b09af4deed40278da87)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.307143 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c9d9-a0c6-4f52-9714-9b2ca7b21bac None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.310380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 205/414] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:17 2022] GET /identity/v3/projects/7ada4f5619714b09af4deed40278da87 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:17.316358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:17.350346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc090a-49f3-450e-beea-4224dffc4125 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.350674 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc090a-49f3-450e-beea-4224dffc4125 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.350899 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc090a-49f3-450e-beea-4224dffc4125 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.352571 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 206/415] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:17.358736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.359046 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.359286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.393220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:17.394496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:17.506353 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca05e3-9dca-4ad2-8180-bfa7bf1a0ae2 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:17.506972 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:17.519345 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 207/416] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:17.543021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:17.549356 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.550027 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.550308 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.550581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] PATH_INFO: `/v3/projects/7ada4f5619714b09af4deed40278da87/groups/237e796cc837412ba36b30906e299559/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.552852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ada4f5619714b09af4deed40278da87, group_id=237e796cc837412ba36b30906e299559, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.554361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.569886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 210/417] 10.222.0.78 () {58 vars in 1442 bytes} [Thu Aug 25 03:00:17 2022] PUT /identity/v3/projects/7ada4f5619714b09af4deed40278da87/groups/237e796cc837412ba36b30906e299559/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:17.909021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:18.021670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294b061-b27f-49df-ba82-67a0dbbc082e None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:18.066619 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:18.067275 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.067552 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.067838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.082468 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:18.087235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:18.088169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:18.088981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:18.093103 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 208/418] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:18.100474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:18.223881 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db707b-0c5c-4fd6-aa14-b1e2f906df55 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:18.271615 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:18.272608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.273081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.273564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.274420 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:18.274932 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:18.276730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0144-fb07-4834-be10-1767a7ab4b4a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:18.292059 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 211/419] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:18.297463 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:18.381643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:18.442260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21fa75-5c0e-4781-87d8-0bc006f7d991 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:18.486401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969933c-355f-4ca1-b54c-09841a740e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:18.486946 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969933c-355f-4ca1-b54c-09841a740e6e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.487225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969933c-355f-4ca1-b54c-09841a740e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.487495 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969933c-355f-4ca1-b54c-09841a740e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.568840 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77040923-5b62-4619-877f-4e110ae15d89 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.569459 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77040923-5b62-4619-877f-4e110ae15d89 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.569933 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77040923-5b62-4619-877f-4e110ae15d89 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.571447 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 212/420] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:18.577005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.577539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.578027 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.583019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969933c-355f-4ca1-b54c-09841a740e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:18.591842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969933c-355f-4ca1-b54c-09841a740e6e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:18.618386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:18.619623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:18.688160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:18.700556 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:18.753259 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 213/421] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:18.767448 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 209/422] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:18.773151 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:18.787543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea883f1-430b-4f53-ac80-b7ef1d729261 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.787858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea883f1-430b-4f53-ac80-b7ef1d729261 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.788143 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea883f1-430b-4f53-ac80-b7ef1d729261 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.789451 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 210/423] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:18.799500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.799860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.800195 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.831859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:18.833050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:18.912929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecf42e-0608-4d5b-b117-5458d189ff21 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:18.964129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:18.964760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:18.965037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:18.965300 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:18.967706 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:18.969164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:18.971752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 214/424] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:18 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:18.979350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 211/425] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:18.980141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.028295 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:19.081887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176edc-3bd9-4005-a29e-740ceb767fe0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.117822 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.118706 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.118957 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.119226 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.120341 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:19.121768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:19.128157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 215/426] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:18 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:19.130018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.176514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.231880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:19.274631 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b4222-a721-4660-8e24-b008f0ba7822 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.346590 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.347216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.347498 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.347772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.348528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:19.348839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:19.350276 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:19.361944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d252-f8ae-4a99-b9ab-63edb402405d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.364046 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 212/427] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:19.395033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:19.429189 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.429851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.430139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.430411 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.443081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.460159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:19.466508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:19.468050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 03:00:19.468857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:19.474105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 216/428] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:19.475100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.586152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979177f-47d4-4d1d-8ddf-f97ca0b9c132 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.629721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.629944 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.630161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.630318 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.644890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:19.651293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:19.652203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:19.653048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 213/429] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:19.659520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.672459 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:19.676280 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd6c09-2ad6-449b-ab5a-3a372970ddc2 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.725252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.726456 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.727355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.728138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.729023 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] RBAC: Adding query filter params (name=member) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:19.729791 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:19.731741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:19.744797 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 217/430] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:19.751491 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.799322 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:19.806479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473af60a-386c-4e92-84d8-079ed71eabe4 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.855398 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.856783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.857286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.858291 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.859869 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:19.860373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:19.862435 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:19.874522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 214/431] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:19.879910 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:19.888171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf671b4b-6608-43ba-b82e-ec18e4a8670f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:19.939107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedf4a7-9fb1-47c0-b531-6b4f52d45b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:19.939722 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedf4a7-9fb1-47c0-b531-6b4f52d45b0d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:19.940025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedf4a7-9fb1-47c0-b531-6b4f52d45b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:19.940367 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedf4a7-9fb1-47c0-b531-6b4f52d45b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:19.995147 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.036470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedf4a7-9fb1-47c0-b531-6b4f52d45b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.037419 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedf4a7-9fb1-47c0-b531-6b4f52d45b0d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.040610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44726-be56-4153-8f9b-069caeea29fa None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.086991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475219d7-51e2-47a7-81e9-b0ae5cf29d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.087994 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475219d7-51e2-47a7-81e9-b0ae5cf29d4f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.088276 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475219d7-51e2-47a7-81e9-b0ae5cf29d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.088546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475219d7-51e2-47a7-81e9-b0ae5cf29d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.089712 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.175154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 218/432] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:20.176345 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4be43-c15a-4707-ab6e-0b6789f81f82 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.176634 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4be43-c15a-4707-ab6e-0b6789f81f82 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.176904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4be43-c15a-4707-ab6e-0b6789f81f82 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.178231 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 219/433] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:20.180615 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4be43-c15a-4707-ab6e-0b6789f81f82 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.185812 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475219d7-51e2-47a7-81e9-b0ae5cf29d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.187261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475219d7-51e2-47a7-81e9-b0ae5cf29d4f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.262036 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.292220 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4be43-c15a-4707-ab6e-0b6789f81f82 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.296895 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 215/434] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:20.297967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.298253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.298528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.320155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:20.321422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:20.341513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.342936 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.343221 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.343493 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.344758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.346232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.348111 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 220/435] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:20.348706 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.353636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.415879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 216/436] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:20.415879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.460939 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491746bc-22e8-4726-a3a1-85de74089f75 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.498858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9f94d-48ff-4c79-ad14-d711db642759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.499507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9f94d-48ff-4c79-ad14-d711db642759 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.499768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9f94d-48ff-4c79-ad14-d711db642759 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.500083 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9f94d-48ff-4c79-ad14-d711db642759 None admin] PATH_INFO: `/v3/projects/4eb447cdf07f48efaf2af44b4af271dc` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.501208 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9f94d-48ff-4c79-ad14-d711db642759 None admin] RBAC: Authorizing `identity:get_project(project_id=4eb447cdf07f48efaf2af44b4af271dc)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.502635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9f94d-48ff-4c79-ad14-d711db642759 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.504652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 221/437] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/projects/4eb447cdf07f48efaf2af44b4af271dc => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:20.505361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b23b-b5d0-457e-bb80-b36afb56bf1d None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.505640 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b23b-b5d0-457e-bb80-b36afb56bf1d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.505911 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b23b-b5d0-457e-bb80-b36afb56bf1d None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.507055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 222/438] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:20.511670 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2b23b-b5d0-457e-bb80-b36afb56bf1d None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.541844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.545594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e8fd3-6a59-47c8-a2c8-4aa960cff3f5 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.587065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d16b-75bf-4a97-b65b-14c57688cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.587805 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d16b-75bf-4a97-b65b-14c57688cd49 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.588168 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d16b-75bf-4a97-b65b-14c57688cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.588536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.589108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d16b-75bf-4a97-b65b-14c57688cd49 None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.590422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3d16b-75bf-4a97-b65b-14c57688cd49 None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.592695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3d16b-75bf-4a97-b65b-14c57688cd49 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.594378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 217/439] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:20.595669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.595979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.596252 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.614694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:20.615883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:20.620949 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2b23b-b5d0-457e-bb80-b36afb56bf1d None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.655228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.655877 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.656163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.656421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.657549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.658951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.660542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 223/440] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:20.660542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.690990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 218/441] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:20.692256 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.772658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c550f7-e3c1-4602-94d4-5d68db7b5a81 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.793476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.797971 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177847-27d2-4c60-b2f7-f2cffcebfe1e None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.811202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.811807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.812235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.812505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.813337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=9dab23bd829c4bd09bc84413f424696c, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:20.813641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.815097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.831864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 224/442] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=9dab23bd829c4bd09bc84413f424696c => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:20.831864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.833744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:20.847251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.848113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.848454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.848795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.849604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=4eb447cdf07f48efaf2af44b4af271dc) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:20.849983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.851778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.868648 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 219/443] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=4eb447cdf07f48efaf2af44b4af271dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:20.955523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f92395-bf21-4d4e-b32f-562c693c7486 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.997142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.997805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.998110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.998391 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.011117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:21.016828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:21.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:21.018650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 225/444] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:21.024613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.024785 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.112494 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.156566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ff329-4dea-46b9-aace-a842c6196dda None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.161064 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb25830-d574-48ba-854e-20374002afc5 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.192379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.192993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.193268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.193549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.194205 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:21.194510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.195896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.198978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.199608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.200303 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.200408 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.205826 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 220/445] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:21.210465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.216943 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:21.222243 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:21.223128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:21.224155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 226/446] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:21.229054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.239522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.329420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e8104-342c-4a39-a9cd-ad98dc6887e6 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.358622 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22248ba4-5d24-4311-81dc-21b1d1dda491 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.367669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.368575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.368915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.369194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.389940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.403511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.404429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.404738 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.404982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.405653 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:21.406518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.408006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.420266 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 227/447] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:21.427372 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.455517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.455720 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.480226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.541156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47ac0f-69c8-4446-86b4-8d80bd4e6eb0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.555631 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 221/448] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:21.561944 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.579538 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.580113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.580397 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.580691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.635788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.650493 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.651977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.662084 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98e39a-dd69-44ff-af58-fc9219ca30db None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.685421 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.696663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.697292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.697601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.697875 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] PATH_INFO: `/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.698998 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] RBAC: Authorizing `identity:get_project(project_id=c05a289ca3534ce698aab7ae7dfcc8dc)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.700467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.702702 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 222/449] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/projects/c05a289ca3534ce698aab7ae7dfcc8dc => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:21.708198 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.756905 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 228/450] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:21.762435 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.809804 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9061-b07e-4a8a-a0b0-ca0271072778 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.842791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.843348 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.843476 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.843624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.843931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] PATH_INFO: `/v3/groups/712a754f37d849d28f4df6f3f237a7fd` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.845090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] RBAC: Authorizing `identity:get_group(group_id=712a754f37d849d28f4df6f3f237a7fd)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.846497 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.848215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 223/451] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/groups/712a754f37d849d28f4df6f3f237a7fd => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:21.853713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.859501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09306-56be-4aa3-be35-c94221b7278a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.892858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:21.893491 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:21.893763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:21.894028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] PATH_INFO: `/v3/projects/7ada4f5619714b09af4deed40278da87` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:21.895119 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] RBAC: Authorizing `identity:get_project(project_id=7ada4f5619714b09af4deed40278da87)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:21.896591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:21.898187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 229/452] 10.222.0.78 () {56 vars in 1186 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/projects/7ada4f5619714b09af4deed40278da87 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:21.903519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:21.913846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:21.957938 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8829-f84d-428d-add9-0b0bd75c35e2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:21.999656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:22.000284 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:22.000559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:22.000825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:22.001542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] RBAC: Adding query filter params (group.id=712a754f37d849d28f4df6f3f237a7fd, role.id=528407bf4d38459a97d4e921cd7f7123, scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:22.001844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:22.003247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:22.004635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911dd8-7c45-4d02-b1ad-23f0ad8a5e50 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:22.008880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 224/453] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/role_assignments?group.id=712a754f37d849d28f4df6f3f237a7fd&scope.project.id=c05a289ca3534ce698aab7ae7dfcc8dc&role.id=528407bf4d38459a97d4e921cd7f7123 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:22.040202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27dbe-426b-4f7e-94e5-db0291933bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:22.040851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27dbe-426b-4f7e-94e5-db0291933bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:22.041130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27dbe-426b-4f7e-94e5-db0291933bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:22.041402 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27dbe-426b-4f7e-94e5-db0291933bc9 None admin] PATH_INFO: `/v3/groups/237e796cc837412ba36b30906e299559` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:22.042581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27dbe-426b-4f7e-94e5-db0291933bc9 None admin] RBAC: Authorizing `identity:get_group(group_id=237e796cc837412ba36b30906e299559)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:22.044310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27dbe-426b-4f7e-94e5-db0291933bc9 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:22.046787 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 230/454] 10.222.0.78 () {56 vars in 1180 bytes} [Thu Aug 25 03:00:21 2022] GET /identity/v3/groups/237e796cc837412ba36b30906e299559 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:22.052849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:22.159221 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285311d2-7a50-4245-b798-0653bb0f5b6d None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:22.184074 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:22.196318 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:22.196921 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:22.197197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:22.197463 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:22.198184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] RBAC: Adding query filter params (group.id=237e796cc837412ba36b30906e299559, role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=7ada4f5619714b09af4deed40278da87) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:22.198488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:22.199975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61290-d844-47bf-9619-9bdff61d7590 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:22.207874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 225/455] 10.222.0.78 () {56 vars in 1376 bytes} [Thu Aug 25 03:00:22 2022] GET /identity/v3/role_assignments?group.id=237e796cc837412ba36b30906e299559&scope.project.id=7ada4f5619714b09af4deed40278da87&role.id=7f519a00587a4cb38cff222d59894a29 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:24.715180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38071b45-a265-423e-bf5c-b5fe5e3aafed None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:24.715737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38071b45-a265-423e-bf5c-b5fe5e3aafed None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:24.715737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38071b45-a265-423e-bf5c-b5fe5e3aafed None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:24.718055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 231/456] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:24.723544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150a14-1fdb-45e1-8f3f-e6e312376315 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:24.723977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150a14-1fdb-45e1-8f3f-e6e312376315 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:24.724202 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150a14-1fdb-45e1-8f3f-e6e312376315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:24.744527 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-49150a14-1fdb-45e1-8f3f-e6e312376315 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:24.745765 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-49150a14-1fdb-45e1-8f3f-e6e312376315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:24.817085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 226/457] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:24.911299 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12ed8-8592-4e2c-b763-20e5ec244e17 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:24.911656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12ed8-8592-4e2c-b763-20e5ec244e17 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:24.911903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12ed8-8592-4e2c-b763-20e5ec244e17 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:24.913292 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 232/458] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:24.919290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f2ee-6ef5-49a5-a814-4d3dc5a7c6e5 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:24.920024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f2ee-6ef5-49a5-a814-4d3dc5a7c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:24.920536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f2ee-6ef5-49a5-a814-4d3dc5a7c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:24.940523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-6572f2ee-6ef5-49a5-a814-4d3dc5a7c6e5 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:24.942110 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-6572f2ee-6ef5-49a5-a814-4d3dc5a7c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:25.027042 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 227/459] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:25.096353 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66c01-f683-4acc-a89d-f469dbd053c3 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.096686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66c01-f683-4acc-a89d-f469dbd053c3 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.096959 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66c01-f683-4acc-a89d-f469dbd053c3 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.098598 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 233/460] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:25.103752 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cbfc-8400-4caf-b4f4-f9151d9edbd7 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.104073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cbfc-8400-4caf-b4f4-f9151d9edbd7 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.104352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cbfc-8400-4caf-b4f4-f9151d9edbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.124763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-76c1cbfc-8400-4caf-b4f4-f9151d9edbd7 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:25.126048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-76c1cbfc-8400-4caf-b4f4-f9151d9edbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:25.172476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.178513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66c01-f683-4acc-a89d-f469dbd053c3 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.200147 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 228/461] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:25.211591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.304751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66c01-f683-4acc-a89d-f469dbd053c3 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.346495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.347483 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.347998 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.348499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.360495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:25.362214 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:25.375128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464cb0-f552-4eb6-94c1-a4b63f553f0d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.375412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464cb0-f552-4eb6-94c1-a4b63f553f0d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.375690 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464cb0-f552-4eb6-94c1-a4b63f553f0d None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.377034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 229/462] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:25.378636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:25.379566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:25.380505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:25.380505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:25.380505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:25.381982 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.382267 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.382543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.383097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 234/463] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:25.387071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.402104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:25.403567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:25.469847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.477554 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 230/464] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:25.478822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.500628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3455c-bfc8-4f3d-a994-349a894f30e7 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.537106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.537746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.538030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.538306 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.549052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:25.550500 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:25.571873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:25.572994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:25.573865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:25.573865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:25.573865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:25.573865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 235/465] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:25.574105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.606895 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a84af-7d65-4cd4-bfef-0055a7d962aa None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.616697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.648979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.650560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.650843 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.651117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.651753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:25.652085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:25.653449 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:25.678848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 231/466] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:25.678848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.682518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afcd6-2b19-4e50-a71f-6dc4b132bbef None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.710525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.720328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.720940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.721222 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.721496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.733299 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:25.734772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:25.751079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:25.752268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:25.753152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:25.753152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:25.753152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:25.754077 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 236/467] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:25.754826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.787219 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b72852-a8b0-4c16-b633-6b6446fe1fae None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.822476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.823015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.823291 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.823563 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.824231 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:25.824539 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:25.825975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:25.837036 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 232/468] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:25.837963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.866080 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.871754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c5812-54df-4403-8487-074deecb24a0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.905416 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c230a-091f-441c-8913-52e587300e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.906019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c230a-091f-441c-8913-52e587300e72 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.906298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c230a-091f-441c-8913-52e587300e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.906571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c230a-091f-441c-8913-52e587300e72 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.907203 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c230a-091f-441c-8913-52e587300e72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:25.908669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c230a-091f-441c-8913-52e587300e72 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:25.930262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 237/469] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 03:00:25 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:25.931069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c230a-091f-441c-8913-52e587300e72 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:25.950940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab3551-7753-406f-91c4-eed3e7c5139d None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:25.973438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:25.996329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:25.997029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:25.997315 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:25.997634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:25.998288 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:25.998594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:26.000030 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:26.013800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 233/470] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:26.014474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:26.063529 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c230a-091f-441c-8913-52e587300e72 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:26.101953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:26.102836 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:26.103260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:26.103673 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:26.115236 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:26.116727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:26.124263 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:26.135024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:26.135988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:26.136984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:26.136984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:26.136984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:26.136984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 238/471] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:26.136984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:26.145592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9283d-bba0-45a1-9431-3309e905da78 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:26.185829 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:26.186438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:26.186713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:26.186980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:26.187610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:26.189183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:26.212784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 234/472] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 03:00:26 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:26.213411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:26.238570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:26.257695 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a20491-8770-42dc-926b-d0662fc6b324 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:26.299299 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:26.300087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:26.300376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:26.300649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:26.301312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:26.303053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:26.337988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 239/473] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 03:00:26 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:26.388062 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce3dd-9d01-4f17-831f-a0988a91810c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:26.433352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:26.434192 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:26.434671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:26.435266 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:26.436393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:26.436709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:26.438186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ca66-c4ce-4858-b432-809e734db7a4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:26.453613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 235/474] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:26.459120 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:26.586197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6bee-0b35-418f-ac82-56f82335f977 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:26.626283 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee893f3-28f0-4181-badf-f1e2146a3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:26.626900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee893f3-28f0-4181-badf-f1e2146a3719 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:26.627177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee893f3-28f0-4181-badf-f1e2146a3719 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:26.627446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee893f3-28f0-4181-badf-f1e2146a3719 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:26.628129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee893f3-28f0-4181-badf-f1e2146a3719 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:26.629608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee893f3-28f0-4181-badf-f1e2146a3719 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:26.649323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:26.655888 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 240/475] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 03:00:26 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.280679 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c392b-0f2c-43d4-a59c-6e31a8486fbd None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.281709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c392b-0f2c-43d4-a59c-6e31a8486fbd None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.282208 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c392b-0f2c-43d4-a59c-6e31a8486fbd None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.283741 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 236/476] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:28.289303 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf0508-beca-4dc7-b116-d0d4d4b97ed4 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.290103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf0508-beca-4dc7-b116-d0d4d4b97ed4 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.290577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf0508-beca-4dc7-b116-d0d4d4b97ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.308765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-a1cf0508-beca-4dc7-b116-d0d4d4b97ed4 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:28.310810 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-a1cf0508-beca-4dc7-b116-d0d4d4b97ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:28.380476 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 241/477] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:28.594814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a5f0b-9920-4efb-b59b-ae3648a7eb98 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.594814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a5f0b-9920-4efb-b59b-ae3648a7eb98 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.594814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a5f0b-9920-4efb-b59b-ae3648a7eb98 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.594814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 237/478] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:28.600672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.601193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.601668 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.621175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:28.623302 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:28.652558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803d6b-e7bb-4e04-ac09-5bc36035b719 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.652870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803d6b-e7bb-4e04-ac09-5bc36035b719 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.653115 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803d6b-e7bb-4e04-ac09-5bc36035b719 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.654674 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 238/479] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:28.659831 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.660120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.660391 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.668457 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.682399 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:28.684463 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:28.696367 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 242/480] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:28.754620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 239/481] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:28.759640 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.821564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.872292 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c390d4-4bdd-418f-97f9-0ece5f54aa85 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.908068 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610d7ed-f83c-49cd-b630-0fdd375a3878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.908703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d7ed-f83c-49cd-b630-0fdd375a3878 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.908980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d7ed-f83c-49cd-b630-0fdd375a3878 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.909253 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610d7ed-f83c-49cd-b630-0fdd375a3878 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.920491 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610d7ed-f83c-49cd-b630-0fdd375a3878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-5610d7ed-f83c-49cd-b630-0fdd375a3878 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:28.925108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:28.925984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:28.926901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 243/482] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:28.932156 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.012582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993a4d-45f7-4b5f-ae74-163cd480649c None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.012862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993a4d-45f7-4b5f-ae74-163cd480649c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.013287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b993a4d-45f7-4b5f-ae74-163cd480649c None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.014885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 244/483] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:29.020092 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.020379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.020658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.039215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8846f-5f0b-4362-9a2d-84f2f2029bde None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.041287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.042588 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.075306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.075993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.076237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.076516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.077169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:29.077472 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.078838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.081121 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.090672 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 240/484] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:29.090672 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.118678 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 245/485] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:29.119598 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.178017 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.203203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b11e5-ec7b-4321-be88-76c77431bcd2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.229388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b243c-9203-4784-b46a-d41e8afb4f6c None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.239682 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.240456 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.240738 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.241055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.251579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:29.256698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.257585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:29.258387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 241/486] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.259076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.269879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.270559 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.270785 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.271055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.282171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.283729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:29.298177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.299619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:29.300518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:29.300518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:29.300518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:29.300518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 246/487] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.300518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.323652 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.375287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276841d-6b41-4a7f-99d5-817c594f3565 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.411595 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.412263 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.412547 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.412818 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.416174 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.419898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4a89-59ec-456b-a2d4-bf73ad72717d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.423689 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:29.428455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.429344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:29.430186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 242/488] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.430872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.458695 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.459288 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.459570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.459871 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.460533 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:29.460837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.462191 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.470594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 247/489] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:29.471288 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.543770 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5ec5-775d-4123-9835-548af7181b2e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.566018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.573437 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5564506-2646-40a5-986e-e69308b02334 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.586547 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.587155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.587434 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.587706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.588395 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:29.588698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.590050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.602066 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 243/490] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:29.603226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.613659 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.614293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.614574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.614849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.615516 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:29.615875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.617246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.625994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 248/491] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:29.626784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.653659 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.705197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5885-ab58-49f6-919e-ffcbdc709026 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.727998 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4838c0-aa2c-45bd-8c50-5ed6dbad552b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.737018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.737746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.738145 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.738489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.749341 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:29.754365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.755283 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:29.756134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 244/492] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.756813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.763801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.764449 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.764728 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.764995 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.775543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.777020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:29.790605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.791523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:29.792726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:29.792726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:29.792726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:29.792726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 249/493] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.792964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.797280 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.876811 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865a17-a18a-4b05-9309-22543d08c233 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.878564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.902717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673704e-9727-49ee-a61f-485f4d7e6d6d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.916252 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.916885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.917164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.917437 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.924846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.926289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.937772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.938395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.938676 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.938949 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:29.939213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.940321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 245/494] 10.222.0.78 () {56 vars in 1093 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.941450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.953290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.954733 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:29.968523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:29.969484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:29.970325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:29.970325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:29.970325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:29.970325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 250/495] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:29.970325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.040973 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.047359 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f2be5-d32e-4696-84dc-b56470a7eb10 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.068648 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ad1c0-e5c3-4ebd-b145-27c88bb78ee3 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.080897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.081494 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.081777 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.082049 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.082704 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.083006 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.084394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.092849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 246/496] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.093645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.095045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.103600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.104246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.104529 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.104805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.105448 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.105752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.107131 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.119539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 251/497] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.120418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.192635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f813c3-a212-451d-9431-e2811afa2c19 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.223986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5989-4fa6-4e69-9b53-5bea5a978cf3 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.226392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.226993 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.227268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.227536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.228282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.228642 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.230699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.263606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.264242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.264522 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.264793 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.265432 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.265734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.267100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.268873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 247/498] 10.222.0.78 () {56 vars in 1133 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.269704 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.280626 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 252/499] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.281440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.290998 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.333529 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.374455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309293b-1972-4203-ae65-f30cf1a6017b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.385372 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf4fe-3f2b-4b48-bce8-c0cf80ea2532 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.407606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.408276 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.408976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.408976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.418139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.418517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.418739 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.419015 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.419293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.420656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.427129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.428588 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:30.434806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:30.435882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:30.436750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:30.436750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:30.436750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:30.436750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 248/500] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:30.436750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:30.440521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:30.441545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 253/501] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:30.442700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.511691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.545250 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966bdb2-b83c-404f-a7c9-05fcac7e13fa None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.550932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26b33d-dad9-4a81-89cc-a59b64f9219f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.554276 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.578870 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.579432 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.579727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.580010 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.585510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.586200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.586536 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.586813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.589094 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.590557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:30.602399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:30.603489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 254/502] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:30.609801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.666070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.667539 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.702196 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162618-e5bc-4903-9ac1-9b2748597756 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.729925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.736020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.736624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.736913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.737193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.738161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.738161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.739542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.751419 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 255/503] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.752237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.768942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 249/504] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:30.769705 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.780904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.851916 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc0f7f-8f5a-410c-b6ad-6b888104cdf3 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.866787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a5c2c-cf1a-49b3-b70f-58be4d71ff8c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.884946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.885542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.885816 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.886090 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.886807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.887107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.889122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.900128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.900731 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.901013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.901288 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.902010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:30.902321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.903797 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.921021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 250/505] 10.222.0.78 () {56 vars in 1137 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.921844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.925990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 256/506] 10.222.0.78 () {56 vars in 1137 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:30.926748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.954779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.014971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.027297 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac735021-c264-4cd5-b48d-257d9181232b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.030163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352180d-8ad5-4e5d-b6f6-e62d147e6107 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.062629 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.063258 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.063542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.063847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.064056 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.064679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.064962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.065234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.070713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.072203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.075843 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.077297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:31.083384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:31.084458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 251/507] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:31.085620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:31.092713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:31.093798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:31.094893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:31.094893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:31.094893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:31.094893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 257/508] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:31.094893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.174373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.189165 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f47e-d54e-4fa7-a2ec-d7e8eca9e284 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.195499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7aa0d-b0cf-4179-b927-22bbce32d84a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.222953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.223560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.223870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.224148 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.229023 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.229617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.229894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.230200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.239555 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.290421 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.291836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.299638 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.301134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.374635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.390573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 252/509] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:31.391395 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.405741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 258/510] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:31.406674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.447105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.492008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060c660-784a-4670-b269-d4f3ba986f00 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.507924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea925387-99e6-4287-ad54-ad77f817db3f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.525799 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.526423 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.526702 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.526975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.527703 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:31.528040 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.530039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.541946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.542481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.542757 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.543025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.543683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:31.544020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.545399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.546635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 253/511] 10.222.0.78 () {56 vars in 1139 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:31.547436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.557293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 259/512] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:31.558097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.594293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.651839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec976-d450-4f0f-8dcd-c90491164474 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.664923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.668809 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec73bc-c9da-4836-b040-245b86fbd98f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.687529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.688190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.688474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.688746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.698701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.700188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.703748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.704412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.704697 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.704971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:31.715294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:31.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:31.717785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:31.717785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:31.717785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:31.717951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.718030 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 254/513] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:31.718098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.718171 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:31.734754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:31.735699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:31.736612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:31.736612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:31.736612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:31.736612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 260/514] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:31.736839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.815994 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.822343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8817ba-4e2b-4eb1-aca3-8364db6690e3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.834920 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b969-15fd-485d-af59-0b31a604e950 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.856630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.857260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.857537 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.857807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.868997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.869616 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.869892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.870169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.877255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.879194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:31.891443 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:31.892501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:31.893549 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 261/515] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:31.897959 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.910008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.924126 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.925582 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.997208 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652948e9-bb62-436b-b604-e2b93e538bdd None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.018332 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.026317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 255/516] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:32.028732 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.031246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.031875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.032162 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.032440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.033085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.033388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.034772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.046692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 262/517] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.047571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.117459 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.134357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f75e5-4435-4367-ae4a-3a513d576f15 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.149661 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bab9b-ce5a-4a83-a5bc-c7ccf4b8492e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.168054 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.168655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.168934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.169216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.169843 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.170137 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.171488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.182478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 256/518] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.183255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.185664 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.186330 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.186613 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.186885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.187575 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.187914 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.189355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.207678 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 263/519] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.208354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.240714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.283790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292a1ca-e3ef-4e51-8ca8-42e8504dee47 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.306460 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575988-e94f-45b8-b510-1bf7ca5f8543 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.317232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.317872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.318157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.318434 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.329323 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.330854 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.336623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.342853 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.343481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.343760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.344062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:32.345573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:32.346606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:32.347677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:32.347677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:32.347677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:32.347677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 257/520] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:32.348061 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.353501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.355196 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:32.367344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:32.368730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 264/521] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:32.369605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.451031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879123c-5b78-4f60-9195-e942ca452c5c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.459700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.467561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889b33-6d78-4e08-8d58-b40133d65de0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.484847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.485480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.485755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.486024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.492477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.494179 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.501895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.502490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.502769 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.503041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.503749 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=f197d1797b6044b494fdff7290d66a9a) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.504089 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.505496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:32.506934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:32.507746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:32.508636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 258/522] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:32.509282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.528060 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 265/523] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/role_assignments?user.id=f197d1797b6044b494fdff7290d66a9a&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.528060 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.589895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.634700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d24bd-d7eb-4176-b5a3-2b599a4b348a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.648862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfecfca-15a3-4171-b9a8-11f4faf14118 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.674085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.674710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.674988 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.675265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.675951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.676261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.677667 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.689625 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.690240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.690514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.690780 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.690983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 259/524] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.691472 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.691773 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.691972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.693229 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.708071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 266/525] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.709194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.725181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.801862 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39b41f-74b7-4638-a92c-651e70477457 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.820242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4d4d-da9d-4b30-9cc6-e1778b53efa2 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.836011 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.839384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.840028 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.840630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.840630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.841289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:32.841594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.843035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.858033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.858667 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.858951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.859230 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.861560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 260/526] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:32.862818 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.866109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.868040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:32.881268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:32.882166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 267/527] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:32.883633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.964147 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.977610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff40a-b10e-4bd4-a2eb-0cabb21a8bd0 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.990561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799423d4-ac3f-4437-a633-98d7ae2c3594 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:33.015299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.015937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.016221 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.016495 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.017214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=f930d1296fbe4539b3cdb2a292b48604) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:33.017523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.018959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.024267 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 261/528] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/role_assignments?user.id=f930d1296fbe4539b3cdb2a292b48604&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:33.025043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:33.037038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.037944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.038369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.038796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.039848 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=4ebfffc00f19438a99c15c9e17c24719) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:33.040179 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.041771 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.059845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 268/529] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/role_assignments?user.id=4ebfffc00f19438a99c15c9e17c24719&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:33.164480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc68b-4f1a-4a1a-86d8-826d0d4d36b4 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:33.208721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.209353 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.209630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.209903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.210604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:33.210908 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.212527 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1457-66fe-440d-b028-5bd75814824f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.227454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 262/530] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:33.233422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:33.282708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:33.348945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf7e0e-fca1-4ab0-b504-2d237895e89d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:33.385487 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.386228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.386579 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.386924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.387714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=4fab6f04a71044c8a5c16944dc5fb349) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:33.388674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.390163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc762b-6bcd-49b4-b3b4-2e0d81fb82bf None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.396285 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 269/531] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:33 2022] GET /identity/v3/role_assignments?user.id=4fab6f04a71044c8a5c16944dc5fb349&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:34.731225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2a998-dca2-4901-b13c-fc32a4e6c921 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:34.732035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2a998-dca2-4901-b13c-fc32a4e6c921 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:34.732035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2a998-dca2-4901-b13c-fc32a4e6c921 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:34.733417 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 263/532] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:34.738950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1e0f-8156-4fb9-aedd-266e727e92dd None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:34.739371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1e0f-8156-4fb9-aedd-266e727e92dd None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:34.739537 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1e0f-8156-4fb9-aedd-266e727e92dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:34.758507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-877d1e0f-8156-4fb9-aedd-266e727e92dd None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:34.759708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-877d1e0f-8156-4fb9-aedd-266e727e92dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:34.831748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 270/533] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:35.162965 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2a998-dca2-4901-b13c-fc32a4e6c921 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.180712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.276550 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2a998-dca2-4901-b13c-fc32a4e6c921 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.312914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.313646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.313931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.314207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.316180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40e26-4e97-4c6c-a163-33aff73ff3aa None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.316473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40e26-4e97-4c6c-a163-33aff73ff3aa None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.316754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40e26-4e97-4c6c-a163-33aff73ff3aa None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.318576 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 271/534] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:35.327954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:35.329543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b37-d749-4b0f-ae92-0009a1b03acc None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:35.332873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:35.333990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:35.335014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 264/535] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:35.336472 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b37-d749-4b0f-ae92-0009a1b03acc None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.337606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.338110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b37-d749-4b0f-ae92-0009a1b03acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.359454 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-55ef9b37-d749-4b0f-ae92-0009a1b03acc None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:35.360802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-55ef9b37-d749-4b0f-ae92-0009a1b03acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.389204 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.415887 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.440382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 272/536] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:35.440382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668c59-d740-4546-b4dd-994a26f15671 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.440382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668c59-d740-4546-b4dd-994a26f15671 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.440382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668c59-d740-4546-b4dd-994a26f15671 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.440382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 273/537] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:35.443141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eba99-440f-4e15-b8d4-81b2c89576c3 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.443714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eba99-440f-4e15-b8d4-81b2c89576c3 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.444286 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eba99-440f-4e15-b8d4-81b2c89576c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.462386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9bab7-b666-4eb4-b8c2-678d740c545c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.470878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-e30eba99-440f-4e15-b8d4-81b2c89576c3 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:35.472400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-e30eba99-440f-4e15-b8d4-81b2c89576c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.503635 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.504577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.505043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.505456 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.506281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:35.506747 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.508481 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.517980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 265/538] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:35.523065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.555419 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 274/539] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:35.626834 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414519b7-8fd5-4be4-b777-9d7b033de2ff None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.627168 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414519b7-8fd5-4be4-b777-9d7b033de2ff None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.627402 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414519b7-8fd5-4be4-b777-9d7b033de2ff None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.628999 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 275/540] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:35.636836 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.637447 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.637737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.645982 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b66a-8a78-4b0c-81b1-d6f7952f9acf None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.657081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:35.658262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.689162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.690229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.690662 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.691073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.697154 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.710243 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.712612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:35.738718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:35.740214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:35.741123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:35.741123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:35.741123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:35.741856 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 266/541] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:35.747073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.759926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 276/542] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:35.793071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.818723 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.868057 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73025e5f-f9e7-44a9-9c45-42de932a2642 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.902823 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.903974 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.904255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.904520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.905153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:35.905452 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.906813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.910494 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b81ca-42bd-4838-bd23-4051a066b348 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.919876 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 267/543] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:35.921700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.951777 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.952729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.953220 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.953650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.967059 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:35.968802 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:35.973363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:35.974474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:35.975475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:35.977003 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 277/544] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:35.977772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.029377 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e581fd-8d7e-49a7-8d24-e8655c4e02e3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.061420 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.066873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.067505 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.067779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.068073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.079075 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:36.082820 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed24c6b-725f-487c-b048-76b83f867c39 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:36.083666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:36.084778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 268/545] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:36.085583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.122577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.123206 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.123478 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.123746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.131130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.132620 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:36.144388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:36.145409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 278/546] 10.222.0.78 () {56 vars in 1093 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:36.146702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.192886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406041ba-25b5-4375-ba27-a871ac5ef6c6 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.200108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.227902 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.228449 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.228730 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.229005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.229764 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:36.230070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.231500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.239380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 269/547] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:36.240200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.245426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d5f3a-c2b4-476b-887e-2fdb8e8e5a1f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.279341 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.279975 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.280254 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.280527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.281186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:36.281489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.282861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.290817 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 279/548] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:36.293083 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.296840 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.345983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3f7d6-315d-4c16-9f2e-ce332d43f22b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.380040 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.380663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.380946 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.381218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.392035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:36.393924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aecc9-fd09-4f69-9545-a9a0a1f8381c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:36.397038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:36.398050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 270/549] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:36.398893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.427481 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.428287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.429289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.429585 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.429865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.430680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:36.430989 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.432458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.451193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 280/550] 10.222.0.78 () {56 vars in 1133 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:36.452041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.500348 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafd78c-527c-4e09-9344-989b8ed491e1 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.514118 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.533818 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.534443 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.534718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.534990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.545308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.546748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.553458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691853e-cdc3-4c1c-b949-0a510ca24a93 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:36.560743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:36.561647 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:36.562779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:36.562779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:36.562779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:36.562779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 271/551] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:36.563152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.592438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.593068 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.593347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.593615 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.603486 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.604966 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:36.619368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:36.620457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:36.623104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:36.623104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:36.623104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:36.623104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 281/552] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:36.623104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.649793 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.671194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475677-81c6-488a-9f57-a37c49491728 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.709260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.709868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.710149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.710420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.711079 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:36.711381 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.712779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.720967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 272/553] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:36.721604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.729251 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14747-5952-446c-8b23-4d745ba046e4 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.743844 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.765757 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.766364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.766575 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.766842 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.777692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.779215 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:36.793451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:36.795031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:36.795958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:36.795958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:36.795958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:36.795958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 282/554] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:36.796180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.821380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b20d7f-706d-4285-8e52-300c90aaaee3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.853600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.854200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.854481 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.854783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.855390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:36.855692 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.857617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.869431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 273/555] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:36.870269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.874559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.898436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6bac5-56b3-441f-8e1b-84930064a32a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.931260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.931885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.932170 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.932442 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.933075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:36.933376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.935362 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.946852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 283/556] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:36.947644 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.973304 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.976948 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adeeeb-d638-4771-9402-295a4a6b0cd8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.011739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.012383 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.012739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.013022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.022832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.024267 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:37.038838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.040011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:37.041325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:37.041325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:37.041325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:37.041325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 274/557] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.041325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.050021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702b6c-63b6-4616-a067-dbbddc2fa0d1 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.084226 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.084878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.085107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.085385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.086020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:37.086323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.087683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.097432 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.098666 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 284/558] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:37.099453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.142959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70da64-b074-4da9-b66e-d7c93147df83 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.176505 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.177132 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.177410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.177683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.186043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.188019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.191096 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:37.200883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.202428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 275/559] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.203573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.214924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb354e-f5d6-41c2-b014-273065c25f9a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.251963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.252707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.253070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.253452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.261480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.263119 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:37.275324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.276421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 285/560] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.277424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.334204 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbb169-875e-40ac-a170-9d09d90f3b79 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.349018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.370822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.371438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.371720 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.372049 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.372692 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:37.372999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.374377 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.385952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 276/561] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:37.386776 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.392633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5c38e-fa7e-42cd-aa99-6e8d72e2f07a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.428791 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.429671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.430177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.430600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.438492 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.440806 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:37.452386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.453558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:37.454687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:37.456392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 286/562] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.457358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.467659 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.503836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9d25-36fb-4bd4-b259-4602fd138ac6 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.538663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.539197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.539479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.539755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.540516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:37.540823 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.542332 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.559221 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 277/563] 10.222.0.78 () {56 vars in 1137 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:37.559906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.568368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7df5b-4619-4122-b8a8-888f3592a56b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.589410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.602858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.603461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.603741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.604071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.604786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:37.605103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.606571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.624504 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 287/564] 10.222.0.78 () {56 vars in 1137 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:37.625331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.660109 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683731-7dde-45d9-95dc-58fcfba25393 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.687170 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.694042 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.694673 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.694955 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.695238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.703504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.705105 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:37.725461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.726644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 03:00:37.727628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:37.728228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59f0c-4610-4f65-9324-ada28219cece None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.728317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 278/565] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.728317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.763342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.763982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.764261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.764528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.765207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:37.765536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.766955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.779118 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 288/566] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:37.781012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.820483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.830548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87806232-f6a0-4339-95cf-ba461fb47141 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.863454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.864118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.864398 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.864675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.875962 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.877407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.881572 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699d7c-a0a5-424c-810a-781f5c15757d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:37.893428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.899164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:37.900384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:37.900384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:37.900384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:37.900384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 279/567] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.900384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.913062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.924155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.924779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.925058 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.925333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.936134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.937586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:37.951786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:37.952941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:37.954275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:37.954275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:37.954275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:37.954275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 289/568] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:37.954275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.000430 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda917a-2045-45eb-85a5-63ba311d1336 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.033791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.034384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.034655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.034922 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.035632 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.035967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.037379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.054044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 280/569] 10.222.0.78 () {56 vars in 1139 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:38.054344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff035-5de0-498d-b425-fd020ce83c51 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.054854 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.059059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.090330 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.090914 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.091199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.091485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/f197d1797b6044b494fdff7290d66a9a/roles/be90cb2a180e4d96942e089640221a37` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.105915 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=f197d1797b6044b494fdff7290d66a9a, role_id=be90cb2a180e4d96942e089640221a37)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.107358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.120893 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 290/570] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:00:37 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/f197d1797b6044b494fdff7290d66a9a/roles/be90cb2a180e4d96942e089640221a37 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:38.128826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.160290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.165382 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf9ce2-e843-482d-8926-6217317c0d2f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.206220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.207217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.207772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.208116 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.208772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.209073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.212058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.229876 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 281/571] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:38.232013 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.254926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d245-714f-4a3a-8866-9b8eec13ac3c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.292682 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.293413 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.293696 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.294501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.295164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.295451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.296861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.310863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.312683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 291/572] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:38.313499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.359429 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc655d-9c1e-4110-b39b-6b0ddc6d22b2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.394541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.395286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.395563 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.395845 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.406713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.408182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.416120 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:38.426093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:38.427240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:38.428287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:38.428287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:38.428287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:38.428287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 282/573] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:38.428287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.438328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ddc2-7798-4cec-b3b8-855a6b2e2a44 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.477114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.477874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.478153 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.478423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.486483 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.488032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:38.500238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:38.501182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 292/574] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:38.502117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.543363 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb822f-8313-4354-8885-2336bd2392a7 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.561948 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.585530 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.586162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.586746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.587029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.594930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.596932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:38.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:38.621003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 283/575] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:38.622659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.635097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206aa85-a5fb-4b3c-aa7b-cf07c5649161 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.674780 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.675391 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.675726 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.676049 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.676705 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.677004 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.678381 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.692047 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 293/576] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:38.692978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.702207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.756853 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42164a9-b146-48dd-9e3e-7e342960b75b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.793487 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.794783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.795063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.795335 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.796134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.796441 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.798151 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.803544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97842-7180-49a2-9c01-a444d73a5aec None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.815897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 284/577] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:38.815897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.844413 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.845029 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.845292 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.845563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.846270 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.846570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.848034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.850021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.866771 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 294/578] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:38.867857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.931343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08829902-5660-4b03-93a7-0788bd8ab888 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.936069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.970233 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.970974 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.971260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.971538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.975480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4158ae-b589-4683-8748-593b8647709c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.978492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.979979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:38.991739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:38.992975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 285/579] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:38.993969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.014940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.015609 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.015918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.016221 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/4ebfffc00f19438a99c15c9e17c24719/roles/be90cb2a180e4d96942e089640221a37` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.031931 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=4ebfffc00f19438a99c15c9e17c24719, role_id=be90cb2a180e4d96942e089640221a37)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.033381 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.046658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 295/580] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:00:38 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/4ebfffc00f19438a99c15c9e17c24719/roles/be90cb2a180e4d96942e089640221a37 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:39.049496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.109195 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:39.117968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c1e97-1e81-4e29-91f5-2b336381762a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.158365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.159044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.159321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.159594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/f930d1296fbe4539b3cdb2a292b48604/roles/be90cb2a180e4d96942e089640221a37` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.176412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=f930d1296fbe4539b3cdb2a292b48604, role_id=be90cb2a180e4d96942e089640221a37)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.177883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.207941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 286/581] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:00:38 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/f930d1296fbe4539b3cdb2a292b48604/roles/be90cb2a180e4d96942e089640221a37 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:39.225137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b5e2-d7e1-4b46-95f0-271f6af8f087 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.254064 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:39.275199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.275864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.276828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.276828 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.277241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:39.277554 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.279617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685baae-050f-4e74-9559-c05284c42c14 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.297699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 296/582] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:39.302251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.427183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37217a0-728d-44d4-8b1d-56dbd253ce00 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.464644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcde21-b412-4975-b3ba-cda5770a7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.465232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcde21-b412-4975-b3ba-cda5770a7f54 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.465514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcde21-b412-4975-b3ba-cda5770a7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.465825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcde21-b412-4975-b3ba-cda5770a7f54 None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/4fab6f04a71044c8a5c16944dc5fb349/roles/be90cb2a180e4d96942e089640221a37` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.481270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcde21-b412-4975-b3ba-cda5770a7f54 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=4fab6f04a71044c8a5c16944dc5fb349, role_id=be90cb2a180e4d96942e089640221a37)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.482790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcde21-b412-4975-b3ba-cda5770a7f54 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.485268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:39.503967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 287/583] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:00:39 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/4fab6f04a71044c8a5c16944dc5fb349/roles/be90cb2a180e4d96942e089640221a37 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:40.377236 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8252620-6390-4a4c-9d3a-a4b786b5b799 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.377779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8252620-6390-4a4c-9d3a-a4b786b5b799 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.377779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8252620-6390-4a4c-9d3a-a4b786b5b799 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.379412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 297/584] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:40.385168 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.385712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.385712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.405035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:40.406247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:40.477120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 288/585] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:40.811618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8252620-6390-4a4c-9d3a-a4b786b5b799 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.920964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8252620-6390-4a4c-9d3a-a4b786b5b799 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.957705 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.958351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.958636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.958911 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.970705 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:40.975436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:40.976525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:40.977395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 298/586] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:40.982930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.094919 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f532136-6717-4568-a3e2-676b9ff8f248 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.121409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.135583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.136422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.136770 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.137263 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.138003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:41.138311 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.139688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.148670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 289/587] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:41.154470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.194701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.270866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adae4d-1bc9-4418-bf0c-5b3d106978ad None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.307197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.307854 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.308140 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.308415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.319953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.321421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-2741af1b-a930-42a5-aa9d-90c7b06f2195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:41.336993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:41.339165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:41.341849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:41.341849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:41.341849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:41.341849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 299/588] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:41.345473 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.373284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cab9b3-110e-4220-9b71-6497dbbf9459 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.373886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cab9b3-110e-4220-9b71-6497dbbf9459 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.374348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cab9b3-110e-4220-9b71-6497dbbf9459 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.375894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 300/589] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:41.381395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.382829 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.383568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.408672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:41.410717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:41.473560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395904-1dea-47e8-9a53-ddb9316df615 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.499453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 301/590] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:41.510448 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.511344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.511885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.512880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.513709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:41.514194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.515740 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bce4c-5dcb-4a6d-a96c-e10f8d126b61 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.529061 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 290/591] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:41.534729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.554167 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.605977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b0801-0e7e-4d49-90cc-0f388a5f8f87 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.606320 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b0801-0e7e-4d49-90cc-0f388a5f8f87 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.606590 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b0801-0e7e-4d49-90cc-0f388a5f8f87 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.608237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 291/592] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:41.616687 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea6dc-315b-49fd-a1b8-499d25da333e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.617124 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea6dc-315b-49fd-a1b8-499d25da333e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.617755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ea6dc-315b-49fd-a1b8-499d25da333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.638711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-6e6ea6dc-315b-49fd-a1b8-499d25da333e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:41.640781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-6e6ea6dc-315b-49fd-a1b8-499d25da333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:41.651926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b888192-2c0c-468d-a016-4801f55dec4b None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.687583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.689467 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.690287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.692115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.692323 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.701423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.702875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:41.715485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:41.721277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:41.722311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 302/593] 10.222.0.78 () {56 vars in 1093 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:41.722913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.733726 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 292/594] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:41.790838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482ab56-95b1-4761-b7de-209d966cea39 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.791183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482ab56-95b1-4761-b7de-209d966cea39 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.791391 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482ab56-95b1-4761-b7de-209d966cea39 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.792990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 293/595] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:41.797875 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.798155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.798424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.819780 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:41.820699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.821706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:41.844032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdfbf6-2643-4309-a5c5-729c9c34c884 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.878889 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.879418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.879700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.880002 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.880734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:41.881044 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.882490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.894344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 294/596] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:41.895182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.908519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 303/597] 10.222.0.78 () {56 vars in 1133 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:41.910093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.017335 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a009-a53c-48c9-9a9a-9ecb3932de21 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.034239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258d1ce-090f-43b9-a44e-2c43090348fb None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.042665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.065581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.066195 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.066474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.066746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.072918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.084293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.085611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.086093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.086821 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.100298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:42.105232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:42.106691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:42.107538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 295/598] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:42.108265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.150746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.152237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.216407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98341ea8-bc90-4c0c-8a2f-ab6abda47b27 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.250360 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.250983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.251266 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.251543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.258519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 304/599] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:42.259337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.266285 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:42.271424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:42.272601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:42.273453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 296/600] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:42.274144 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.293474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.303784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.359933 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e72f-9fd4-4380-af8c-a2756fbdede0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.380133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93af6dd-d60e-4c75-9291-6daa5fae3c8e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.393751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.394358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.394638 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.394912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.395563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:42.395898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.397254 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.405847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 305/601] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:42.406574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.414863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.415493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.415775 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.416083 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.426719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:42.431322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:42.432289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 297/602] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:42.433162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.510288 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.514815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9edef-d05c-4925-9abd-fc07444bc23b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.519115 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.535568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbe034-2da9-427d-81a6-8a850d67df9f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.549600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.550446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.550725 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.550993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.561351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.562803 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.568907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.569507 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.569784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.570055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.570712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:42.571017 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.572433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:42.576923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:42.577876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:42.578788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:42.578788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:42.578788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:42.578788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 306/603] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:42.578788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.584848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 298/604] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:42.585652 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.682081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7acf97-9988-40f5-a1f2-ffbf54069d58 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.700673 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e9fd1-3960-4f72-b906-ec785fa31477 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.716339 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.716972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.717255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.717813 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.728320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.729785 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.736466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.737075 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.737357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.737634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.738299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:42.738606 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.740001 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:42.744388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:42.745407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:42.746333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:42.746333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:42.746333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:42.746333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 307/605] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:42.746333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.748960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.749723 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 299/606] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:42.750498 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.764979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.854466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3727d-a737-47fe-b398-d81a853045bf None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.855637 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb312a17-abab-406c-a19a-dc7ccbc24121 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.886952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.888104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.888380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.888648 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.896252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.897047 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.897484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.897913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.898711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.899097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:42.899577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.900166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.901401 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:42.914890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:42.915891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:42.921904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:42.921904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:42.921904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:42.922095 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 308/607] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:42.922172 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 300/608] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:42.922242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.922321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.978157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.981571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.016377 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518124-331d-49a4-a44a-2ab5d226b4cd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.020535 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95333c-ac97-44c6-a28e-b58a553cebbf None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.055709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.056341 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.056623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.056898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.057536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.057717 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.057864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.058159 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.058436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.058706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.059208 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.069370 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.070237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 309/609] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.070790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.071012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:43.087695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:43.089094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:43.090271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:43.090271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:43.090271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:43.090271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 301/610] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:43.090271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.172720 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb98b2-4fef-41c3-963b-8b9d9c21ad71 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.190558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aa35e-e3ac-460d-bddd-b5291c5a5045 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.195461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.204471 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.207724 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.208407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.208693 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.208966 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.215768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.217262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.225320 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.225925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.226210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.226486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.227136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.227445 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:43.228268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:43.229235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:43.230199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:43.230643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.230714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 310/611] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:43.230714 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.241821 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 302/612] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.242881 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.330757 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47183-a670-4fc1-ad43-17e77c8ab461 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.344393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce1386-7af2-4ebf-8fa0-bd2c4f5beb59 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.369058 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.369912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.370404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.370848 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.378548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.379146 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.379431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.379692 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.380364 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.380669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.380830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.382015 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.382262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.393555 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 303/613] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:43.393945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:43.395211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 03:00:43.396267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:43.396813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.396886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 311/614] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:43.396886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.431500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.440858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.498092 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ad120-051c-4267-91d8-0aaf9d1b2bb0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.499898 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd031b0-ce9d-41ed-b2f3-50b2083bdd1b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.532006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.532217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.532675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.532770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.532889 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.533018 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.533163 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.533279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.533850 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.534159 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.535600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.541430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.542974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.548510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 304/615] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.549306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:43.554978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:43.556007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 312/616] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:43.556964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.642708 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.649568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891d3d9-d8de-43fb-94dc-1dd1dd515805 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.658777 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f33599-44d0-439f-97cb-f1e6a9db5d4d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.660340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.685166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.685789 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.686068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.686345 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.694543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.695199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.696062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.696238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.696335 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.696607 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.697328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.697633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.699082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:43.707888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:43.708860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 305/617] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:43.710138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.722262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 313/618] 10.222.0.78 () {56 vars in 1137 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.723090 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.825820 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113b204-8c88-4822-afb4-1c2a83283e02 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.826725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0458890-626b-4ecc-903d-ca4f1b9c7e10 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.859224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.859847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.859950 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.860122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.860392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.860484 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.860722 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.861000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.861098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.861386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.861717 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=f197d1797b6044b494fdff7290d66a9a) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.862026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.862789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.863416 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.869268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 306/619] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/role_assignments?user.id=f197d1797b6044b494fdff7290d66a9a&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.870244 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.881466 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 314/620] 10.222.0.78 () {56 vars in 1137 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.882792 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.906680 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.907252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.016313 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac3386-356b-47d6-bb5e-0981ed3995bc None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.023358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03874fae-6c2a-4f15-83ee-1005dc62e05b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.056989 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.057871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.057871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.058141 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.059751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:44.059751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.061552 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.069453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.070457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.071147 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.071420 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.083410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 307/621] 10.222.0.78 () {56 vars in 1139 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:44.084724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.148712 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.150170 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.169523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.176578 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.208920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920daa-60c4-4c3e-8ffd-27a8c4742853 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.250029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.250632 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.250911 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.251183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.261408 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 315/622] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:44.261408 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.330600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.332101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.368261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a007-543d-487f-b04f-71647944cb36 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.385520 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.403409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.404053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.404257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.404517 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.418684 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.448490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 308/623] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:44.449418 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.477746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.479207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.558825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3896d-a0bf-4123-8436-1891bc8a3b5d None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.584008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 316/624] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:44.584008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.601388 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.602025 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.602309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.603102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.603228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.616217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.617946 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:44.636308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:44.637947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:44.638849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:44.638849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:44.638849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:44.638849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 309/625] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:44.638849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.671010 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.699284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881db3d0-2864-49df-9b4f-77ff22fc363b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.735877 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.736774 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.737055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.737486 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.749798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.752179 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.754819 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea6cb2-3666-4666-800e-6abdfc377c62 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:44.771586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:44.772799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:44.773721 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:44.773721 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:44.773721 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:44.775973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 317/626] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:44.777550 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.802153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.802787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.803083 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.803336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.815713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.817216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:44.833658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:44.834840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:44.836287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:44.836287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:44.836287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:44.836287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 310/627] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:44.836287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.857798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.896510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d6fab-d00b-499b-9de2-1538f122abb8 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.922656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.933277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.933883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.934692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.934967 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.935607 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:44.935944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.937328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.946053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ddf4c-7899-466d-be20-7d2d71e84b4a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.950359 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 318/628] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:44.951524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.985267 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.985865 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.986148 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.986423 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.987073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:44.987385 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.988790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.007346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 311/629] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.007346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.074544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb90587-3cb5-4e00-894e-c5b40bc5320b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.105369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.112702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.113318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.113602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.113877 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.114514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.114823 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.116230 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.122917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746c61f-b929-4590-b33f-fb863a177266 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.133212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 319/630] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.133212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.162684 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.163237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.163520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.163790 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.172203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.173661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.177295 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:45.188940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:45.189907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 312/631] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:45.190851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.241378 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d0db-1268-40cb-bb75-0f635fadab1a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.276530 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.277162 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.277444 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.277743 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.284495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.285937 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:45.297663 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:45.298573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 320/632] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:45.299489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.308563 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e324-38b1-445a-b334-86cc2e794467 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.351540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.352512 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.353051 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.353335 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.358973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.362760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.364500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:45.378506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:45.379413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:45.380343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 313/633] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:45.380834 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.419879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ac58b-1146-49e9-9a74-8f091659bdae None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.449368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.460659 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.461279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.461559 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.461831 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.462521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.462831 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.464309 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.476864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 321/634] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.477669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.501841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e922-0188-4814-8279-a7376ebdbf99 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.537575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.538312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.538867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.539040 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.539746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.540086 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.541760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.560847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 314/635] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.560847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.587577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445bf97-b704-4b1e-8337-9ce0f73725fe None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.599075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.624901 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.625524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.625808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.626085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.626781 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.627110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.628562 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.642939 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 322/636] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.642939 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.670287 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007d3bc-b28b-421d-b474-009750679765 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.691094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.705781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.706384 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.706660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.706930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.707644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=4ebfffc00f19438a99c15c9e17c24719) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.708056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.709468 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.716981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 315/637] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/role_assignments?user.id=4ebfffc00f19438a99c15c9e17c24719&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.717769 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.783763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2ed9-4d6e-46f5-8f78-c2af1793fbe2 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.835165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.835798 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.836111 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.836389 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.837453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=f930d1296fbe4539b3cdb2a292b48604) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.837569 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.839156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e9952-ea23-4f51-ae7f-2805c8ffde4f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.852279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 323/638] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/role_assignments?user.id=f930d1296fbe4539b3cdb2a292b48604&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:45.865493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96576679-988c-4d65-935e-7a708d4f2ec2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.908314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.909277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.909739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.910194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.911260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=4fab6f04a71044c8a5c16944dc5fb349) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:45.911770 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.913497 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1365d4f-ac05-4649-b796-9409dab9fb49 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.921902 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 316/639] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/role_assignments?user.id=4fab6f04a71044c8a5c16944dc5fb349&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:46.226866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824558d7-2937-48d5-9062-9233f55280b9 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.227068 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824558d7-2937-48d5-9062-9233f55280b9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.227331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824558d7-2937-48d5-9062-9233f55280b9 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.228918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 324/640] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:46.234661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.234940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.235219 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.256715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.257897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.305473 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:46.335461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 317/641] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:46.663084 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824558d7-2937-48d5-9062-9233f55280b9 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:46.699536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:46.773765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824558d7-2937-48d5-9062-9233f55280b9 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:46.808661 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:46.810024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.810473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.810887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.821101 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:46.825948 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:46.827154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:46.828305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:46.830615 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 325/642] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:46.836300 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:46.938664 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a4f8-6337-4f87-be97-5d26703969bb None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:46.975862 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:46.976482 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.976763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.977036 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.977695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:46.977996 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:46.979351 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:46.988841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 318/643] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:46.994646 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.095631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:47.104427 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a549cd-16ed-4498-b9d6-2b43b06bfa0c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.144935 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.145579 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.145864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.146143 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.157817 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.159336 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:47.175078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:47.176106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:47.177618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:47.177618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:47.177618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:47.177618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 326/644] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:47.181823 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.224250 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:47.283673 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102343-e6b3-46d1-ada1-4ad95e7da206 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.321184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.321809 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.322093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.322370 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.323020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:47.323327 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.325254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.337922 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 319/645] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:47.343903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.447700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efcc47-793d-4234-bbec-cdf86202738e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.484744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.485727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.486205 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.486705 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.495051 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.496823 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:47.508507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:47.509523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:47.510590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:47.513994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 327/646] 10.222.0.78 () {56 vars in 1093 bytes} [Thu Aug 25 03:00:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:47.519340 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.620544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:47.624516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a25c5-ada8-482b-a718-63037c911e7e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.660835 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.661446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.661728 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.662000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.662727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:47.663033 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.664496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.683488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 320/647] 10.222.0.78 () {56 vars in 1133 bytes} [Thu Aug 25 03:00:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:47.689649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.702435 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:47.800747 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab40c4-551b-4adc-8643-69bee68c0f58 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.839004 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c1cc-9746-4a53-a93c-af4a67384d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.840085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c1cc-9746-4a53-a93c-af4a67384d19 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.840567 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c1cc-9746-4a53-a93c-af4a67384d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.841033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c1cc-9746-4a53-a93c-af4a67384d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.916972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c1cc-9746-4a53-a93c-af4a67384d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.918956 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c1cc-9746-4a53-a93c-af4a67384d19 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.929238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.029640 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 328/648] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:48.039577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.082317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde27d2-5f7c-4a53-8aa2-14b63da22602 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.082510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde27d2-5f7c-4a53-8aa2-14b63da22602 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.082786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde27d2-5f7c-4a53-8aa2-14b63da22602 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.084391 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 329/649] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:48.093963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.094499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.095120 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.120122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:48.122197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.161578 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7652-32e7-4d10-8456-bcb4fc156adc None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.201810 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.202471 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.202749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.203065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.215741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 330/650] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:48.217370 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.219016 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-1a7c7cd4-25f8-43a7-88b5-4320de5e25ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:48.235803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:48.236864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:48.237781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:48.237781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:48.237781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.239666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 321/651] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:48.248921 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.284387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.297324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abb95-0e7e-44f8-9327-fcbc8760e4c9 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.297602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abb95-0e7e-44f8-9327-fcbc8760e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.297873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abb95-0e7e-44f8-9327-fcbc8760e4c9 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.299440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 322/652] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:48.304630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc55ef-be0d-4adc-825d-32e2e0d3f721 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.305070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc55ef-be0d-4adc-825d-32e2e0d3f721 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.305447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc55ef-be0d-4adc-825d-32e2e0d3f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.325401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-61bc55ef-be0d-4adc-825d-32e2e0d3f721 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:48.328732 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-61bc55ef-be0d-4adc-825d-32e2e0d3f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.331240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.369358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4395764-1c74-43e4-af85-69f548b8c85b None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.399505 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 323/653] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:48.406044 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.406653 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.406928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.407201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.407869 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:48.408175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.409226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a34d-9389-46fa-aabf-ed8788531512 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.409520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a34d-9389-46fa-aabf-ed8788531512 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.409615 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.409801 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a34d-9389-46fa-aabf-ed8788531512 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.415169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 324/654] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:48.416552 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.416844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.417124 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.435387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 331/655] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:48.441515 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.446531 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:48.448477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.539621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 325/656] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:48.562928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.569352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d107-6be3-473d-8dc6-4326d95b68e8 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.591728 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.608066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.608713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.609064 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.609346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.616873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.619145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:48.635298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:48.636314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:48.642452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 332/657] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:48.643311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.685522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.719950 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfddb2c-ad2c-4b8f-95b7-750a5821b742 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.763440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.764387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.764670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.764948 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] PATH_INFO: `/v3/services/image` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.765671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.767651 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.775470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bde99-925f-4b2e-96fd-492f94bdfa2e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:48.780400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:48.781546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.782450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 326/658] 10.222.0.78 () {56 vars in 1105 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:48.783324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.815581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.816398 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.816689 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.816964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.817656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:48.817963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.819403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.832448 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 333/659] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:48.833244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.854446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.898136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef57fe-6cfa-45b2-aca8-8a592afc8ede None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.939368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.940248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.940367 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.940624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] PATH_INFO: `/v3/services/network` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.941211 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.942577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.944401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.947490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741fc9-9b15-4f3a-8619-12d683c40878 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:48.952870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:48.954069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:48.955196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 327/660] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:48.956480 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.989071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.989681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.989961 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.990235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.990861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:48.991152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.992824 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.997442 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 334/661] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:48.998252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.055556 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47acf4d-29ba-415d-a946-b5619892a70b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.082056 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:49.093048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.093658 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.093939 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.094215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.094941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=f197d1797b6044b494fdff7290d66a9a) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:49.095249 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.096708 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.102058 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1724a-f005-47cc-b0bf-5911114a43f1 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.102302 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 328/662] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/role_assignments?user.id=f197d1797b6044b494fdff7290d66a9a&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=7f519a00587a4cb38cff222d59894a29 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:49.103182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.159753 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.160400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.160749 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.160957 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.162320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.162998 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:49.176234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:49.180399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:49.181307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 335/663] 10.222.0.78 () {56 vars in 1129 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:49.182494 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.204348 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:49.256199 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5ee9b-5eef-41a5-aee2-ab0e94e887e3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.296599 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.297208 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.297490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.297759 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.298390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:49.298694 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.300094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.305394 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c805c-a00a-4712-b874-a09c29e3f7eb None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.312317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 329/664] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:49.313300 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.347888 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.348611 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.348891 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.349165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.349819 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] RBAC: Adding query filter params (type=image) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:49.350121 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.351743 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.357950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 336/665] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:49.358579 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.382414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:49.456407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13dc53-cb53-460c-a47c-e113b1f0a0e2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.485387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:49.496855 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.497925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.498406 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.498923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.499762 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:49.500294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.501903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.511620 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4567c1-1e38-490f-92ad-857e47a0c30f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.512430 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 330/666] 10.222.0.78 () {56 vars in 1124 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:49.513599 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.548113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.548730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.549015 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.549297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.549928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] RBAC: Adding query filter params (type=network) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:49.550232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.551634 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacab1b-1343-47f5-a9ac-cf34b6474596 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.557133 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 337/667] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:49.633147 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11b1c-67b9-4ed0-8ad6-9309ac62d427 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.674903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.675962 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.676476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.676951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.677799 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:49.678308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.679930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c825a0-78b5-46ed-9142-98caf31e3a97 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.687777 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 331/668] 10.222.0.78 () {56 vars in 1124 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:51.327171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e01de-ffb4-4a65-abc8-99cbf3d192d4 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.327626 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e01de-ffb4-4a65-abc8-99cbf3d192d4 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.327731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e01de-ffb4-4a65-abc8-99cbf3d192d4 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.330209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 338/669] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:51.335273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24d702-64a3-48bb-88cc-27cdc41eb5e2 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.335710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24d702-64a3-48bb-88cc-27cdc41eb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.335917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24d702-64a3-48bb-88cc-27cdc41eb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.354519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-8b24d702-64a3-48bb-88cc-27cdc41eb5e2 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:51.356259 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-8b24d702-64a3-48bb-88cc-27cdc41eb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.409797 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:51.430259 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 332/670] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:51.706499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b5f3-2d85-4f21-bb93-c140fb09a6d9 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.706994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b5f3-2d85-4f21-bb93-c140fb09a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.707382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b5f3-2d85-4f21-bb93-c140fb09a6d9 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.709202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 339/671] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:51.715664 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c09c2-f670-419f-938c-95ef0812dc38 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.716115 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c09c2-f670-419f-938c-95ef0812dc38 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.716487 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c09c2-f670-419f-938c-95ef0812dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.736420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a76c09c2-f670-419f-938c-95ef0812dc38 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:51.737616 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a76c09c2-f670-419f-938c-95ef0812dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.755578 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b5f3-2d85-4f21-bb93-c140fb09a6d9 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:51.814959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 333/672] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 03:00:51.853978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:51.880470 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76725ef-cba5-4a37-a996-521afad15d8d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.880798 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76725ef-cba5-4a37-a996-521afad15d8d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.881067 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76725ef-cba5-4a37-a996-521afad15d8d None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.883564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 334/673] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:51.887649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b5f3-2d85-4f21-bb93-c140fb09a6d9 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.888242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5ccd-d803-4337-9009-7f16a3e24b26 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.888525 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5ccd-d803-4337-9009-7f16a3e24b26 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.888795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5ccd-d803-4337-9009-7f16a3e24b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.908120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-82ad5ccd-d803-4337-9009-7f16a3e24b26 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:51.909753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-82ad5ccd-d803-4337-9009-7f16a3e24b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.931557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.932285 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.932567 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.932837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.949715 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:51.955318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:51.957654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:51.959751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 340/674] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:51.962704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.015893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 335/675] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:52.017549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a968de-34df-4f28-a12e-0a09aa4c9912 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.017839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a968de-34df-4f28-a12e-0a09aa4c9912 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.018118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a968de-34df-4f28-a12e-0a09aa4c9912 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.019587 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 336/676] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:52.025460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.025792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.026026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.045743 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:52.046966 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:52.094306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.107656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d6af9-45cb-433d-932a-9121158cbcbe None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.146452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.149041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 337/677] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 03:00:52.154973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.155927 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.156418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.156937 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.158310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:52.158852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.160973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.161829 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.175196 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 341/678] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:52.180326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.303367 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139c4d-f462-4592-a88a-1fdd771196c8 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.312311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28dcae-2435-4552-b877-3cdb348c6a5e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.353462 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.354693 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.355184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.355711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.356924 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.358688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.366275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.366800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.367144 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.367431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.381617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.383175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.385194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 338/679] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:52.386600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:52.406284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:52.407340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:52.408315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:52.408315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:52.408315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:52.408315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 342/680] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:52.408315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.441062 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.476541 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.539080 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c3973-0eca-4e62-ab10-a0fe525be906 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.547365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee307a-6ec8-4b73-a8f1-45fc7bae66ca None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.588342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.589193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.589473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.589776 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.590410 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:52.590716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.592106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.600550 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.601531 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.602021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.602497 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.603572 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.606604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.607423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 343/681] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:52.608546 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.631839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 339/682] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/services => generated 240 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:52.631839 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.736808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482447-f13a-4be0-b263-1377018f9551 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.747606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.786178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.806312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.806559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e08c-c51e-4b59-9c00-958b176eaa79 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.807157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.807512 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.807962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.808864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.811054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.837334 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 344/683] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:52.867882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.868538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.870247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.870247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.879406 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.880973 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:52.894104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:52.895309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:52.896500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 340/684] 10.222.0.78 () {56 vars in 1093 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:52.905014 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.030194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857a6c-45fc-4a1d-b6a9-bfc05ee1872e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.069711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.070331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.070608 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.070875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.071607 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:53.071936 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.073649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.095203 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 345/685] 10.222.0.78 () {56 vars in 1133 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:53.100691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.211580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a5e7-485e-461e-8689-42cc933522a3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.262674 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.263620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.264164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.264648 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.276436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.278696 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.280852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:53.295139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:53.296415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:53.297326 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:53.297326 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:53.297326 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:53.299153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 341/686] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:53.304422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.334910 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:53.423350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dcb2c-cb0e-43cd-ae1a-f4fb92925802 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.462777 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.463418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.463923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.464360 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.465654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:53.465959 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.467324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.483929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 346/687] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:53.485460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.595596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3ec0-a14d-4c97-b596-d79423cc9526 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.632878 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.633523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.633800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.634074 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.642748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.644242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:53.656714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:53.659085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:53.661253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 342/688] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:53.665177 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.759473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:53.784483 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e206-130c-4a2c-b3e0-c07de39cb690 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.819881 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.820499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.820775 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.821046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.821735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:53.822036 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.823462 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8c859-a28b-4b36-b2c4-76e3903f9007 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.837563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 347/689] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:53.844031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.906446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:53.953765 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cacb52-f757-4012-95e3-816729d5d52e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.989645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683e90-2e67-4a3c-859b-9eec56fdb455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.990302 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683e90-2e67-4a3c-859b-9eec56fdb455 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.990579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683e90-2e67-4a3c-859b-9eec56fdb455 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.990852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683e90-2e67-4a3c-859b-9eec56fdb455 None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/f197d1797b6044b494fdff7290d66a9a/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.993040 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683e90-2e67-4a3c-859b-9eec56fdb455 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=f197d1797b6044b494fdff7290d66a9a, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.994467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683e90-2e67-4a3c-859b-9eec56fdb455 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.010149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 343/690] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:00:53 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/f197d1797b6044b494fdff7290d66a9a/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:54.812118 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48483e4-94e1-4ca0-8cee-f2462ce32a6f None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.812651 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48483e4-94e1-4ca0-8cee-f2462ce32a6f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.813071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48483e4-94e1-4ca0-8cee-f2462ce32a6f None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.815263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 348/691] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:54.822206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da0c8a-9cd7-4555-ba2d-c458f86c1d59 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.822707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da0c8a-9cd7-4555-ba2d-c458f86c1d59 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.822785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da0c8a-9cd7-4555-ba2d-c458f86c1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.841761 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-05da0c8a-9cd7-4555-ba2d-c458f86c1d59 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:54.842978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-05da0c8a-9cd7-4555-ba2d-c458f86c1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:54.926680 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 344/692] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 03:00:55.034778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17eea-26d4-4577-a9fb-d84528263c0b None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.035458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17eea-26d4-4577-a9fb-d84528263c0b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.035981 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17eea-26d4-4577-a9fb-d84528263c0b None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.037763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 349/693] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:55.044436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a2e53-af5d-494d-b433-a302a6ec4842 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.044725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a2e53-af5d-494d-b433-a302a6ec4842 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.044999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a2e53-af5d-494d-b433-a302a6ec4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.065064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-7c7a2e53-af5d-494d-b433-a302a6ec4842 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:55.066247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-7c7a2e53-af5d-494d-b433-a302a6ec4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:55.113493 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.143586 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 345/694] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:00:55.184643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da120a-9374-4537-b0e1-3e8b58c30df3 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.184986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da120a-9374-4537-b0e1-3e8b58c30df3 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.185198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da120a-9374-4537-b0e1-3e8b58c30df3 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.186872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 350/695] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:55.192692 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.193004 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.193251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.213900 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:55.215618 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:55.285122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da120a-9374-4537-b0e1-3e8b58c30df3 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.412273 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da120a-9374-4537-b0e1-3e8b58c30df3 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.415565 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 346/696] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:00:55.449680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.450313 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.450597 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.450868 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] PATH_INFO: `/v3/services/image` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.451461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.452912 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:55.461973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:55.463134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:55.464081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:55.467922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 351/697] 10.222.0.78 () {56 vars in 1105 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:55.470347 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.505622 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.510834 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.606170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050a064-e00a-4103-859c-dd7d10119c8c None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.608937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.647545 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.648179 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.648454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.648725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.649350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] RBAC: Adding query filter params (name=image) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:55.649650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.651009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.654979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158cc9b-e6a7-45af-81af-4beb6e7f40ca None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.659944 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 347/698] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:55.662411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.701800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.703017 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.703576 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.704188 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] PATH_INFO: `/v3/services/network` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.704784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.706163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:55.721148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:55.722232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:55.723125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:55.730418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 352/699] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:55.731583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.782273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c14e-801e-44db-b045-497584f9e75e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.813675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.819228 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.820278 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.820558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.820832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.821464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] RBAC: Adding query filter params (type=image) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:55.821768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.823136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.829314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 348/700] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:55.832696 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.864680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a2a28-1dd6-488f-aee3-d8c3fe68938e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.878921 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.905582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.906201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.906830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.906830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.907504 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] RBAC: Adding query filter params (name=network) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:55.907793 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.909216 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.919075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 353/701] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:55.919075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.966519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f82269-b095-47f2-b546-0d2ad4492679 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.004951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.005585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.005859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.006128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.006707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.008274 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:56.018085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:56.019108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:00:56.020014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:56.024053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 349/702] 10.222.0.78 () {56 vars in 1129 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:56.024919 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.034199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc6f7-7431-49b7-922d-23f2ca5402fd None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.066864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.073958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.075155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.075548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.075849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.076666 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] RBAC: Adding query filter params (interface=public, service_id=c9aa0367685244f4a603d0bc8b556e7c, region_id=RegionOne) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:56.076975 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.078349 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.086569 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 354/703] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/endpoints?service_id=c9aa0367685244f4a603d0bc8b556e7c&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:56.087186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.129404 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.137123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c868b2-88c4-4e4e-8716-4e62683183ab None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.175723 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.176376 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.176650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.176923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.177549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] RBAC: Adding query filter params (type=network) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:56.177847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.179199 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.186034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 350/704] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:56.186876 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.216600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb6ef-1fd0-4a34-9b6a-2dfa1621b219 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.257823 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.258720 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.259166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.259599 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.260420 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:56.260723 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.262090 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.271840 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 355/705] 10.222.0.78 () {56 vars in 1124 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:56.272508 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.306018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4d1c1-d422-49c9-a62b-8964a65d9859 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.342899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.347769 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.348409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.348689 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.348960 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.349564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.350907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.357244 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 351/706] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/services => generated 1002 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:56.357739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.396968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.403699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993d8b6-9c27-4eeb-8371-7c7f48c8a14c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.443261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.443920 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.444205 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.444478 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.445200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] RBAC: Adding query filter params (interface=public, service_id=59527c588e5d48df9d9156c4ea73de93, region_id=RegionOne) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:56.445507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.446926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c98d3-fd9d-404b-9669-c62907e88dcc None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.452831 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 356/707] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/endpoints?service_id=59527c588e5d48df9d9156c4ea73de93&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:56.454189 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da54a0-510d-486a-8827-b88f385dcc23 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.454485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da54a0-510d-486a-8827-b88f385dcc23 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.454762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da54a0-510d-486a-8827-b88f385dcc23 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.456400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 357/708] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:56.458261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da54a0-510d-486a-8827-b88f385dcc23 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.486874 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078ddf2-344d-4bc5-ac47-8ec7e690844c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.526665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.527882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.528338 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.528617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.529264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:56.529572 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.530961 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf58f-d75d-45af-849b-a43292c1c555 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.541333 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 352/709] 10.222.0.78 () {56 vars in 1124 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:56.541333 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.541333 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.541333 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.558106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:56.559193 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:56.586074 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da54a0-510d-486a-8827-b88f385dcc23 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.611007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.624666 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.625275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.625559 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.625851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.626453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.627837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.633080 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 358/710] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:00:56.633851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.635007 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 353/711] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:00:56.756299 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba238db-0b15-41d2-9d4f-b80aa0e1ef1d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.797154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.797775 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.798057 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.798331 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.799040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] RBAC: Adding query filter params (interface=public, service_id=8ebbde7c2189432fa19d08e4d75d1291, region_id=RegionOne) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:56.799350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.800774 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.807088 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 359/712] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/endpoints?service_id=8ebbde7c2189432fa19d08e4d75d1291&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:56.813064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.837024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.924254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386df4-2c10-4afb-9395-df80fc2d5117 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.959978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.960595 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.960877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.961151 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.961760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.963116 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.969841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 354/713] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/services => generated 1002 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:57.028999 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.094183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:57.150188 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c897f-ee2c-4db1-bdd5-bcee5396c686 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.187789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.188454 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.188737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.189008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.202130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:00:57.208113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:57.209109 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:57.210268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 360/714] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:57.217763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.313281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:57.341479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7d997-f200-44bf-8a21-d276ce146a89 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.376907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.377789 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.378213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.378624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.379435 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:57.379909 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.381477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.391217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 355/715] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:57.396922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.512105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f88af-0399-4907-ba57-838e00fb9778 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.526392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:57.550205 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.551097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.551523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.551972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.564476 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.566197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:57.582898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:57.584172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:57.585278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:57.585278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:57.585278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:57.586691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 361/716] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:57.592968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.697490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad39a8-f4ca-4ca5-a742-aeac5426f53c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.733727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.734347 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.734631 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.734906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.735556 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:57.735915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.737453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.755358 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 356/717] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:57.757218 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.869210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de703eb-5e2e-4bc7-b353-5504bcc029b7 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.905713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.906595 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.907020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.907467 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.915469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.917319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:00:57.929403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:57.930547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 03:00:57.931710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:00:57.934512 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 362/718] 10.222.0.78 () {56 vars in 1093 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:57.941228 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.945336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:58.064235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa59124-064a-4223-aeb1-2f3a6d87c48a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.106899 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.107544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.107847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.108135 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.108896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:58.109209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.110673 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.135300 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 357/719] 10.222.0.78 () {56 vars in 1133 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:58.136665 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.165056 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:58.246567 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae188-30ad-40ac-9dfe-8575fe4129cc None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.282125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.282731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.283010 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.283279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.365123 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.366592 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.396832 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:58.472405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 363/720] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:00:58 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 03:00:58.478524 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.564344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:58.589396 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f9a1-2f92-4b63-9f92-821e0b3689c8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.632211 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.632930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.633215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.633488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.645787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.647314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-81d77bf7-5954-4d17-9e2c-74a2d70de478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:00:58.663601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:58.664654 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:00:58.665580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:00:58.665580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:00:58.665580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:58.669566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 358/721] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:58.672932 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.794101 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3e1c-3015-46ba-b9ad-8188566d5303 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.794464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3e1c-3015-46ba-b9ad-8188566d5303 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.794663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3e1c-3015-46ba-b9ad-8188566d5303 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.797766 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 359/722] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:58.802915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.803260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.803486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.826237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:58.828368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:58.909600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5561ff-2c41-4f16-a73c-b4c274abd7db None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.914740 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 360/723] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 03:00:58.945153 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.945763 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.946045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.946319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.946961 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:58.947270 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.948793 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db71b9-f8fa-4f08-94a1-8e572a192651 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.952270 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:58.962470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 364/724] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:58.968583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.974964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514575e-f897-45d8-8f37-b2994cc5ed6a None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.975240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514575e-f897-45d8-8f37-b2994cc5ed6a None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.975513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514575e-f897-45d8-8f37-b2994cc5ed6a None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.977116 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 365/725] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:00:58.982551 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.982934 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.983211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.003297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:59.004643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:59.022478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:59.084377 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314b4b-5fd4-4cba-9e9e-37b820c1f687 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.088319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 366/726] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:00:59.121928 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.122576 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.122859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.123136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.130414 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.131878 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:00:59.144464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:59.145433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:00:59.146668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.149465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 361/727] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:59.151962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.261941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.263264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39dc2e-3e11-449d-b86d-d5d5ac0eb610 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.279293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:59.307075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.307691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.308006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.308377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.309645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:59.310067 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.311927 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.335511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 367/728] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:59.341292 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.395332 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65b84f-b65d-42ae-a2a3-41da75e568e3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.397695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:59.433367 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.434153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.434443 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.434710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] PATH_INFO: `/v3/services/image` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.435323 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.436706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-36a5334d-32fd-48f5-bad6-9ca94b02bf75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:59.448238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:59.450176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.452621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 362/729] 10.222.0.78 () {56 vars in 1105 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:00:59.454184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26899de-592c-428c-9415-65cc8993f9e0 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.454184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26899de-592c-428c-9415-65cc8993f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.454184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26899de-592c-428c-9415-65cc8993f9e0 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.455299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 363/730] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:00:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:59.456689 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26899de-592c-428c-9415-65cc8993f9e0 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.471291 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba60f-a869-439b-990d-157c4ed9905a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.510119 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.510720 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.511005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.511311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.512114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=f197d1797b6044b494fdff7290d66a9a) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:59.512370 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.513813 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.519709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 368/731] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/role_assignments?user.id=f197d1797b6044b494fdff7290d66a9a&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=7f519a00587a4cb38cff222d59894a29 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:59.520532 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.579936 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26899de-592c-428c-9415-65cc8993f9e0 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.592919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:59.624373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.625020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.625298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.625570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] PATH_INFO: `/v3/services/network` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.626155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.627560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-117326a4-9ccc-44c1-9fc6-8155d367cf58 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:00:59.637992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:00:59.639134 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:00:59.644937 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 364/732] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:00:59.646119 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.646119 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.646119 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.666509 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:59.668357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:59.677446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788358-05ba-4840-ba28-29c0bae5f4a7 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.698428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:59.716052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.716662 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.716963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.717238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.717861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] RBAC: Adding query filter params (name=image) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:59.718159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.719507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.725335 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 369/733] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:59.726113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.746734 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 365/734] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:00:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:00:59.747686 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.849556 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5c3ea-da76-4c73-b606-46add7fbe30e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.851510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:59.866127 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0066b6-e8a3-4afd-abf8-56972610124f None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.898870 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.899483 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.900024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.900301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.901580 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] RBAC: Adding query filter params (name=network) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:59.902462 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.903765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.905932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.906601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.906942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.907276 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.908012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:59.908373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.908823 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 370/735] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:59.909771 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.914859 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.921878 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 366/736] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:59.922918 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.952650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.036364 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326475-a415-495f-aeff-b40f79811da3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.067587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d3af5-fdea-46cb-a975-4dba54d18032 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.073152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.074469 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.074752 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.075022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.075737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.077240 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.102655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 367/737] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:00.103409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:00.125262 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.126386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.126999 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.127482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.128421 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] RBAC: Adding query filter params (type=network) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:00.128963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.130742 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.138258 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 371/738] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:00:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:01:00.143755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:00.189884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.219582 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.241169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8bf85-06fb-44cd-b184-bb7c0cbe4e2b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.279995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.280655 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.280940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.281214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.281815 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.283218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:00.293178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:00.294316 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 03:01:00.295262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:00.299422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 368/739] 10.222.0.78 () {56 vars in 1129 bytes} [Thu Aug 25 03:01:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:00.300376 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:00.329961 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ffc4b-d1a0-4e2d-ac26-8846c6bfe039 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.379134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.379750 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.380068 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.380347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.381048 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.382363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.413695 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 372/740] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:00.450701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804fc46-ad6e-40a9-8be7-adc3318a7485 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.500017 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.500988 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.501411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.501827 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.502612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:00.503060 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.504702 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.511992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 369/741] 10.222.0.78 () {56 vars in 1124 bytes} [Thu Aug 25 03:01:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:00.519761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:00.612226 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.638640 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528c94-36e5-4058-b370-28d03eaa80c6 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.677385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.678273 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.678702 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.679126 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.680083 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:00.680552 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.682072 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67383ba3-9c3f-4548-af98-bf8424863f4d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.688439 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 373/742] 10.222.0.78 () {56 vars in 1124 bytes} [Thu Aug 25 03:01:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:00.694517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:00.705362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.801368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0033c-ba27-408c-b71b-6d5746071f65 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.836791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b187-3a90-4cbb-a30b-e455c403d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.837400 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b187-3a90-4cbb-a30b-e455c403d7e7 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.837747 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b187-3a90-4cbb-a30b-e455c403d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.838079 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b187-3a90-4cbb-a30b-e455c403d7e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.838901 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b187-3a90-4cbb-a30b-e455c403d7e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.840458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b187-3a90-4cbb-a30b-e455c403d7e7 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.861941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 370/743] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:01.936657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b223a-1e8e-4e5a-bd61-bfbf176633c7 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:01.937181 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b223a-1e8e-4e5a-bd61-bfbf176633c7 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:01.937181 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b223a-1e8e-4e5a-bd61-bfbf176633c7 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:01.938677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 374/744] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:01.943833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5203b9-28e9-4c94-980e-3a6b0b8f5ff9 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:01.944263 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5203b9-28e9-4c94-980e-3a6b0b8f5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:01.944482 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5203b9-28e9-4c94-980e-3a6b0b8f5ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:01.962825 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-ed5203b9-28e9-4c94-980e-3a6b0b8f5ff9 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:01.964039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-ed5203b9-28e9-4c94-980e-3a6b0b8f5ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:02.027633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:02.047859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 371/745] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:01 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:02.374437 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b223a-1e8e-4e5a-bd61-bfbf176633c7 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:02.408516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191aaf-eea7-4a19-bd42-ed38f5b90bab None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.408835 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191aaf-eea7-4a19-bd42-ed38f5b90bab None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.409066 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1191aaf-eea7-4a19-bd42-ed38f5b90bab None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.410518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 372/746] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:01:02.415108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.415387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.415803 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.435321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:02.436516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:02.482599 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b223a-1e8e-4e5a-bd61-bfbf176633c7 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:02.506722 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 373/747] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:02 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 03:01:02.518606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:02.519235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.519511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.519782 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.520395 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:02.521750 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:02.530568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:02.531523 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:02.533006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:02.534118 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 375/748] 10.222.0.78 () {56 vars in 1132 bytes} [Thu Aug 25 03:01:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:02.537547 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:02.641201 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42c10-e54a-4808-9b72-fb1565de2920 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:02.659688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:02.678713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:02.679324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.679607 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.679913 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.680543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:02.680853 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:02.682217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:02.691581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 374/749] 10.222.0.78 () {56 vars in 1126 bytes} [Thu Aug 25 03:01:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:02.692844 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:02.706710 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:02.799264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287933f0-cd41-4fab-979e-8d585998b99b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:02.830667 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:02.832970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:02.833708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.833990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.834377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.835002 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:02.835332 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:02.836679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127484-5a41-454d-89b2-41693a4a389d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:02.842234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 376/750] 10.222.0.78 () {56 vars in 1126 bytes} [Thu Aug 25 03:01:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:02.947943 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ca3f-ac63-4a63-8d4b-bb404e220c83 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:02.985307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63731da-e104-4892-98af-b401043669fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:02.985939 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63731da-e104-4892-98af-b401043669fd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.986216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63731da-e104-4892-98af-b401043669fd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.986486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63731da-e104-4892-98af-b401043669fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.040282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:03.059734 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63731da-e104-4892-98af-b401043669fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.061214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63731da-e104-4892-98af-b401043669fd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.099153 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a4f0-20b2-48d7-b685-4e07491be277 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.099688 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a4f0-20b2-48d7-b685-4e07491be277 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.099688 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a4f0-20b2-48d7-b685-4e07491be277 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.101039 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 377/751] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:01:03.106160 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.106446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.106724 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.125287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:03.126477 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:03.167846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 375/752] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:01:02 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 03:01:03.173389 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63731da-e104-4892-98af-b401043669fd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.199183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 378/753] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 03:01:03.256865 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:03.275943 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63731da-e104-4892-98af-b401043669fd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.311200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.311842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.312144 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.312420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.324321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.327515 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:01:03.342822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:03.344268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:01:03.345261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:01:03.345261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:01:03.345261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:03.345261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 376/754] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:03.350152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.354144 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:03.481213 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e75e-16b3-46b2-8847-34e3d5da77ba None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.520137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.520624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.520898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.521163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.521810 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:03.522105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.524220 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.547870 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 379/755] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:03.549444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.676973 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b454-ad03-42fb-a7c0-5911f826870b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.715884 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.716533 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.716807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.717075 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.717662 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.719036 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.721102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:03.730893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:03.733206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:03.734861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 377/756] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:03.744936 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.821424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:03.865202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ee3c7-0066-426b-981b-30d22914056b None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.908570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.909183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.909461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.909730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.910351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:03.910649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.912040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c33e5-727f-4854-9e49-55520f0d8b81 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.917447 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 380/757] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:01:03.926290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:04.095339 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee221-ad69-43c8-ba01-a1186a5088e3 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:04.132980 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:04.133581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:04.133860 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:04.134131 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:04.134870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:04.135166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:04.137128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af1519-47b8-4924-a3cb-de2c2fafb64a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:04.141852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 378/758] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:05.073754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1ed5-c427-4aa8-b3e1-fe411c0c35a4 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:05.074296 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1ed5-c427-4aa8-b3e1-fe411c0c35a4 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:05.074296 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1ed5-c427-4aa8-b3e1-fe411c0c35a4 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:05.075587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 381/759] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:05.081896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1c57-6193-475f-ba5e-67f4306fedf8 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:05.082355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1c57-6193-475f-ba5e-67f4306fedf8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:05.082831 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1c57-6193-475f-ba5e-67f4306fedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:05.105795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b77f1c57-6193-475f-ba5e-67f4306fedf8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:05.107006 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b77f1c57-6193-475f-ba5e-67f4306fedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:05.167160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:05.186967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 379/760] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:05 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:05.516463 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1ed5-c427-4aa8-b3e1-fe411c0c35a4 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:05.637473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1ed5-c427-4aa8-b3e1-fe411c0c35a4 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:05.662715 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:05.671142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ffb19-fd5f-438a-b111-767e1b63ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:05.671752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ffb19-fd5f-438a-b111-767e1b63ec37 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:05.672062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ffb19-fd5f-438a-b111-767e1b63ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:05.672338 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ffb19-fd5f-438a-b111-767e1b63ec37 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:05.672973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ffb19-fd5f-438a-b111-767e1b63ec37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:05.674365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ffb19-fd5f-438a-b111-767e1b63ec37 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:05.689045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 382/761] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:01:05 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:06.357601 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f83e6-f6a2-45ca-bf45-7b58bccc2c16 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:06.358194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f83e6-f6a2-45ca-bf45-7b58bccc2c16 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:06.358494 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f83e6-f6a2-45ca-bf45-7b58bccc2c16 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:06.360861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 380/762] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:06.366871 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f98f4-3ec8-449c-b815-10fd920e6fa8 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:06.367362 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f98f4-3ec8-449c-b815-10fd920e6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:06.367452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f98f4-3ec8-449c-b815-10fd920e6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:06.387697 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-bc1f98f4-3ec8-449c-b815-10fd920e6fa8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:06.388953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-bc1f98f4-3ec8-449c-b815-10fd920e6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:06.470451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 383/763] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:06 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:06.799865 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f83e6-f6a2-45ca-bf45-7b58bccc2c16 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:06.906713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f83e6-f6a2-45ca-bf45-7b58bccc2c16 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:06.940772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5738-7fd0-4429-86b4-c9e4cba0ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:06.941372 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5738-7fd0-4429-86b4-c9e4cba0ddc3 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:06.941646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5738-7fd0-4429-86b4-c9e4cba0ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:06.941917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5738-7fd0-4429-86b4-c9e4cba0ddc3 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:06.942559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5738-7fd0-4429-86b4-c9e4cba0ddc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:06.943985 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5738-7fd0-4429-86b4-c9e4cba0ddc3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:06.961729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 381/764] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:01:06 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:07.982694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271f5d-a160-4f61-93e6-2548aaa4e2eb None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.983246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271f5d-a160-4f61-93e6-2548aaa4e2eb None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.983246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271f5d-a160-4f61-93e6-2548aaa4e2eb None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.984591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 384/765] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:07.990008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.990443 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.990575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.008900 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:08.010179 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:08.060466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:08.091760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 382/766] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:07 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:08.429025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271f5d-a160-4f61-93e6-2548aaa4e2eb None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.532737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271f5d-a160-4f61-93e6-2548aaa4e2eb None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.546497 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:08.567703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.568352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.568628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.568896 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.569466 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.570866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:08.580073 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:08.581107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:08.582130 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 385/767] 10.222.0.78 () {56 vars in 1132 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:08.587224 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.715258 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3852db5-e77b-47aa-a0e1-0b101a074487 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.749981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.750588 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.750868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.751140 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.751763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:08.752095 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.753450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.758492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 383/768] 10.222.0.78 () {56 vars in 1126 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:08.765019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.862994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a578064-12d5-44ed-bab2-e59c0536e781 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.896537 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.897131 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.897407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.897675 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.898295 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:08.898594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.899980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.904681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 386/769] 10.222.0.78 () {56 vars in 1126 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:08.910676 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.957218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.018836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2eaef-e7e7-4d65-b618-de489d0308df None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.055014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.055650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.056152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.056442 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.057149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] RBAC: Adding query filter params (interface=public, service_id=bee98893d9e840f9bdf8d08d0517dcf8, region_id=RegionOne) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:09.058055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.059427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55e511-0a1e-4f72-8316-33ef7fe98d96 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.066996 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 384/770] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/endpoints?service_id=bee98893d9e840f9bdf8d08d0517dcf8&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:09.073105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.116709 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.170341 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31037d-be01-4045-8042-b36e999b334b None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.170624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31037d-be01-4045-8042-b36e999b334b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.170905 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31037d-be01-4045-8042-b36e999b334b None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.172248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 385/771] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:09.173815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d17b-bb0f-44e5-b2a0-452b3bd5bfae None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.177171 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.177454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.177724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.195713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:09.196942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.208038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.208644 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.208918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.209190 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.209786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.211129 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.216972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 387/772] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:09.268452 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 386/773] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 03:01:09.608381 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.712544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e061e-0051-43af-af34-c3271eb9ac92 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.720882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.748749 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.749383 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.749661 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.749934 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.750510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.751923 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:09.761183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:09.762326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:09.763761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 388/774] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:09.768359 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.803027 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.868904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded2f15-1f7e-4d18-8830-188aa1d913b3 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.904173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.904783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.905058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.905328 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.905954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:09.906253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.907605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.912558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 387/775] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:09.918278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.020050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25864-c0d2-418b-87cf-afca85363c1f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.057652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.058253 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.058532 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.058796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.059457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:10.059753 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.061140 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.066637 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 389/776] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:10.073522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.190712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.194018 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15a4b-9bd9-4d57-aaaa-e0cdf421f0fd None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.231697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.232350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.232630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.232907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.233627 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] RBAC: Adding query filter params (interface=public, service_id=fc4ffccf6d6b43f5a1a127a92d20ff84, region_id=RegionOne) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:10.233935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.235308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c401dea-ce76-46e4-a9d5-b2b35ac785cc None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.241074 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 388/777] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/endpoints?service_id=fc4ffccf6d6b43f5a1a127a92d20ff84&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:10.247996 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.284778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.362970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f962-61c8-47eb-8d99-ebce9dc764f6 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.399386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0e0d-a939-4358-bf86-497c9933257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.400041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0e0d-a939-4358-bf86-497c9933257d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.400317 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0e0d-a939-4358-bf86-497c9933257d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.400585 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0e0d-a939-4358-bf86-497c9933257d None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.401255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0e0d-a939-4358-bf86-497c9933257d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.402618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0e0d-a939-4358-bf86-497c9933257d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.409522 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 390/778] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/services => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:11.467791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28134ab-45be-4973-82c2-a8546ce0be95 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.468361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28134ab-45be-4973-82c2-a8546ce0be95 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.468361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28134ab-45be-4973-82c2-a8546ce0be95 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.469697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 389/779] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:11.474832 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.475270 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.475366 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.493771 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:11.495554 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:11.563566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 391/780] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:11.897142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28134ab-45be-4973-82c2-a8546ce0be95 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.020004 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28134ab-45be-4973-82c2-a8546ce0be95 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.065991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.066620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.066893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.067162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.067740 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.069122 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:12.079118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:12.080251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:12.081239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 390/781] 10.222.0.78 () {56 vars in 1132 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:12.086436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.125465 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.214398 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2dc53-75b4-425c-9f65-3d0beffb696a None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.250430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.251041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.251320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.251591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.252254 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:12.252562 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.253921 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.258751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 392/782] 10.222.0.78 () {56 vars in 1126 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:12.265059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.295702 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.372259 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86410371-3798-4ce9-971d-9801fc20247f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.406248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.406855 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.407135 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.407406 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.408069 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:12.408375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.409736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc225a8a-75bb-4248-9737-92260a18e411 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.419370 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 391/783] 10.222.0.78 () {56 vars in 1126 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:12.420451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.518313 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.527457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2cc5f-5e56-40c5-9cc7-41e0ca28387d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.560736 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6bde-5608-4aa1-87e6-9b4c5f83aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.561327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6bde-5608-4aa1-87e6-9b4c5f83aeda None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.561605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6bde-5608-4aa1-87e6-9b4c5f83aeda None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.561877 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6bde-5608-4aa1-87e6-9b4c5f83aeda None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.562524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d6bde-5608-4aa1-87e6-9b4c5f83aeda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.563909 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d6bde-5608-4aa1-87e6-9b4c5f83aeda None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.583557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 393/784] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:12.636291 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433899a-f896-4ae7-b3b8-c5e39ea90594 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.637155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433899a-f896-4ae7-b3b8-c5e39ea90594 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.637155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433899a-f896-4ae7-b3b8-c5e39ea90594 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.638697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 392/785] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:12.645023 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7042458-a114-44c0-84dc-59eba880677f None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.645307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7042458-a114-44c0-84dc-59eba880677f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.645585 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7042458-a114-44c0-84dc-59eba880677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.664837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-a7042458-a114-44c0-84dc-59eba880677f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:12.666075 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-a7042458-a114-44c0-84dc-59eba880677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:12.763055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 394/786] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:13.094374 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433899a-f896-4ae7-b3b8-c5e39ea90594 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.187067 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:13.197614 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433899a-f896-4ae7-b3b8-c5e39ea90594 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.238343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.238975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.239253 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.239522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.240139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.241764 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:13.250877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:13.252064 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:13.253321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 393/787] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:13.258051 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7042458-a114-44c0-84dc-59eba880677f None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.360692 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:13.394674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7042458-a114-44c0-84dc-59eba880677f None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.438872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.443670 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.443990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.444431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.445087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:13.445391 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.446997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.457762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 395/788] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:13.458653 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.562161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6d76c-5dbe-4147-802e-3fc61ce7220d None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.595953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.596560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.596840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.597115 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.597745 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:13.598051 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.599412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b8bb-2b79-4f66-89c4-5993fe6ab1f8 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.604580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 394/789] 10.222.0.78 () {56 vars in 1114 bytes} [Thu Aug 25 03:01:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:13.610455 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.712642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a797-d11d-4feb-aa59-24dcd29d208e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.753038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f52a0c-51f8-42d4-9d48-2d1e81d38c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.753643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f52a0c-51f8-42d4-9d48-2d1e81d38c41 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.753927 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f52a0c-51f8-42d4-9d48-2d1e81d38c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.754199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f52a0c-51f8-42d4-9d48-2d1e81d38c41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.754859 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f52a0c-51f8-42d4-9d48-2d1e81d38c41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.756279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f52a0c-51f8-42d4-9d48-2d1e81d38c41 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.765991 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:13.778978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 396/790] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:14.873265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba7b4-4b02-4aa2-ba24-a6197d9a8de7 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.873796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba7b4-4b02-4aa2-ba24-a6197d9a8de7 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.873914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ba7b4-4b02-4aa2-ba24-a6197d9a8de7 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.875122 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 395/791] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:14.882731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.883439 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.883644 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.909414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:14.910635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.989630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 397/792] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:15.451964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba7b4-4b02-4aa2-ba24-a6197d9a8de7 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.476999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.558859 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ba7b4-4b02-4aa2-ba24-a6197d9a8de7 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.593034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.593583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.593858 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.594126 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.594712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.596105 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:15.605871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:15.607098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:15.608000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 396/793] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:01:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:15.612905 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.711078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9754e-dd61-485e-9e02-888618cec506 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.732565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.748970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.749576 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.749853 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.750124 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.750746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:15.751046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.752490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658c33-7ce0-4563-9955-5ea314057c3f None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.757581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 398/794] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:15.764364 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.849488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.865782 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b40101-d645-4f26-aab0-0bc0d7b9cd3f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.899717 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.900428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.900618 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.901439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.902071 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:15.902373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.903737 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f161f-049d-40a8-a78c-fa78b7c0cd2b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.908624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 397/795] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:01:16.200919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22f532-16e0-4cfc-be0b-779e31bad0fe None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.201450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22f532-16e0-4cfc-be0b-779e31bad0fe None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.201450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22f532-16e0-4cfc-be0b-779e31bad0fe None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.202756 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 399/796] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:16.208068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.208365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.208645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.228026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:16.229986 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.307904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 398/797] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:16 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:16.643518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22f532-16e0-4cfc-be0b-779e31bad0fe None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.750327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22f532-16e0-4cfc-be0b-779e31bad0fe None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.792602 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.793208 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.793488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.793758 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.794396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.795839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:16.798976 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING keystone.server.flask.common [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 25 03:01:16.824672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.sql.core [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 03:01:16.824672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 03:01:16.824672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [parameters: {'id': 'b079c57069f84ccaba1ce1e076ce1c97', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 03:01:16.824672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b079c57069f84ccaba1ce1e076ce1c97.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b079c57069f84ccaba1ce1e076ce1c97. Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application conn.query(q) Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 03:01:16.850115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result.read() Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 25 03:01:16.851159 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application next(self.gen) Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application yield resource Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application next(self.gen) Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise self.value Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application session.commit() Aug 25 03:01:16.852274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.session.flush() Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application compat.raise_( Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 03:01:16.853393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 03:01:16.855241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application conn.query(q) Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result.read() Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 03:01:16.857062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [parameters: {'id': 'b079c57069f84ccaba1ce1e076ce1c97', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:16.858237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:16.859257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b079c57069f84ccaba1ce1e076ce1c97. Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:16.860581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 400/798] 10.222.0.78 () {60 vars in 1140 bytes} [Thu Aug 25 03:01:16 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:16.861273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.945291 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:16.968457 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d00fc6-7262-4a6c-8e46-ff4bb77eb2c9 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.003292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.003963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.004245 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.004516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.017792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.019528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-2e407d25-422d-400d-b598-816cd06dbdf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:01:17.031516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:17.032698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:17.033699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 399/799] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:01:17.039686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.090972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:17.167722 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d2826-cc66-4e61-9c1d-31803fdf0085 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.199680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.200248 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.200527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.200801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.201457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:17.201993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.203351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c898cf-f629-4b1b-ba67-96803be3fc20 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.222971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 401/800] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:18.158615 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c405a-3604-41b5-a0e1-c39b2f3e35f3 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.159183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c405a-3604-41b5-a0e1-c39b2f3e35f3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.159183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c405a-3604-41b5-a0e1-c39b2f3e35f3 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.160620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 400/801] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:18.166043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109271-10e8-404b-b438-f276ad08f81b None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.166850 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109271-10e8-404b-b438-f276ad08f81b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.167125 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5109271-10e8-404b-b438-f276ad08f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.186344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-f5109271-10e8-404b-b438-f276ad08f81b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:18.187867 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-f5109271-10e8-404b-b438-f276ad08f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.255055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 402/802] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:18.577447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c405a-3604-41b5-a0e1-c39b2f3e35f3 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.686798 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c405a-3604-41b5-a0e1-c39b2f3e35f3 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.721356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bca9a-4d12-438a-bf0e-fd519e1eab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.721968 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bca9a-4d12-438a-bf0e-fd519e1eab54 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.722251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bca9a-4d12-438a-bf0e-fd519e1eab54 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.722525 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bca9a-4d12-438a-bf0e-fd519e1eab54 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.723177 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bca9a-4d12-438a-bf0e-fd519e1eab54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.724568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bca9a-4d12-438a-bf0e-fd519e1eab54 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.734350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.740832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 401/803] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:19.471089 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8251-bb3c-476f-9544-bd77c9533afc None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.471621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8251-bb3c-476f-9544-bd77c9533afc None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.471621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8251-bb3c-476f-9544-bd77c9533afc None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.472997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 403/804] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:19.478257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.479208 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.479373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.498308 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:19.499540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.576727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 402/805] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:19.910100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8251-bb3c-476f-9544-bd77c9533afc None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.940242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.010612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8251-bb3c-476f-9544-bd77c9533afc None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.046493 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.047094 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.047371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.047641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.048294 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.049707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.064582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.sql.core [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 03:01:20.064582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 03:01:20.064582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [parameters: {'user_id': '7312c72367b845e58ada3eaa59ee9ee5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 03:01:20.064582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application conn.query(q) Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result.read() Aug 25 03:01:20.070735 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 03:01:20.071690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application next(self.gen) Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application yield resource Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application next(self.gen) Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise self.value Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application session.commit() Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 03:01:20.072730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.session.flush() Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application compat.raise_( Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 03:01:20.074821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 03:01:20.076052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application conn.query(q) Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application result.read() Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 03:01:20.077272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [parameters: {'user_id': '7312c72367b845e58ada3eaa59ee9ee5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:20.078379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 25 03:01:20.079564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:20.080874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 404/806] 10.222.0.78 () {60 vars in 1131 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/users => generated 160 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:20.081404 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.178047 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166f0c7-17f5-4d9f-afae-849ef68d9f30 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.200573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.211661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.212329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.212610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.213379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.220293 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.221724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-8b6de409-fe92-4109-970d-97fa1caa57e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:01:20.234419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:20.235394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:20.236467 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 403/807] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:20.241734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.332999 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.343422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6821a1-2fd5-49bd-ab3f-e81ed3d45ff7 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.376361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.376953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.377228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.377496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.378176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:20.378473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.380102 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496c114-0141-4077-a56b-262839e54cd8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.417444 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 405/808] 10.222.0.78 () {56 vars in 1101 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:20.975378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1167371-927e-4983-bc5a-65bbe31eb34f None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.975942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1167371-927e-4983-bc5a-65bbe31eb34f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.975942 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1167371-927e-4983-bc5a-65bbe31eb34f None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.977256 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 404/809] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:20.983279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.983684 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.983859 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.003704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:21.005265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.071006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 406/810] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:21.403506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1167371-927e-4983-bc5a-65bbe31eb34f None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.501274 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1167371-927e-4983-bc5a-65bbe31eb34f None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.535157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.535774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.536089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.536361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.536936 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.538291 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:21.547334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:21.548517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:01:21.549558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 405/811] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:21.554471 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.633199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:21.652591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9ac2-24c1-434c-88c5-7aa8df9cc18c None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.685647 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.686252 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.686533 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.686809 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.687425 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] RBAC: Adding query filter params (name=compute) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:21.687727 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.689112 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.693775 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 407/812] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:21.699491 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.747794 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:21.797218 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ae0d-a852-47e5-a0da-b6fdb0c587f1 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.828991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.829575 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.829851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.830120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.830731 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:21.831030 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.832402 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.836964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 406/813] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:21.843578 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.939036 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd11a3f-3259-42bb-b4a6-902326b0d24a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.971699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.972313 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.972591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.972859 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.973536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] RBAC: Adding query filter params (interface=public, service_id=ad5f3bae06f54b5c8c9913fac95969c4, region_id=RegionOne) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:21.973839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.975179 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581c335-f34c-4279-a4a8-1f532163312a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.980013 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 408/814] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/endpoints?service_id=ad5f3bae06f54b5c8c9913fac95969c4&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:21.985607 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.083043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb450c2-3e5a-4de9-80b8-f86df44322d2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.096095 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:22.117734 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e2301-9354-4a93-9d55-0f35cea96964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.118329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e2301-9354-4a93-9d55-0f35cea96964 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.118611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e2301-9354-4a93-9d55-0f35cea96964 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.118885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e2301-9354-4a93-9d55-0f35cea96964 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.120246 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e2301-9354-4a93-9d55-0f35cea96964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.121600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e2301-9354-4a93-9d55-0f35cea96964 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.127683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 407/815] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/services => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:24.307429 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b413f4-3333-4536-869b-53f662b682ce None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:24.307995 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b413f4-3333-4536-869b-53f662b682ce None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:24.307995 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b413f4-3333-4536-869b-53f662b682ce None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:24.309330 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 409/816] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:24.314479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:24.314866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:24.315039 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:24.333561 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:24.334754 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:24.400026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 408/817] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:01:24 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:01:24.731929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b413f4-3333-4536-869b-53f662b682ce None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:24.745297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:24.832697 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b413f4-3333-4536-869b-53f662b682ce None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:24.865164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:24.866035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:24.866312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:24.866582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:24.867149 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:24.868536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:01:24.877571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:01:24.878751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:01:24.879624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 410/818] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:01:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:01:24.884702 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:24.982110 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44760832-77c8-4087-8e2f-1bd7a67e4093 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:24.989193 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:25.016392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:25.017000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:25.017280 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:25.017548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:25.018166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:25.018465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:25.019842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:25.024602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 409/819] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:25.030440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:25.099099 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:25.132277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61703001-ad6f-47eb-b1e0-7af4c2aa1621 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:25.166296 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:25.166894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:25.167174 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:25.167448 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:25.168100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:25.168404 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:25.169767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758052b-f83f-43c8-98f0-1ad30035cf81 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:25.174438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 411/820] 10.222.0.78 () {56 vars in 1112 bytes} [Thu Aug 25 03:01:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:25.180414 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:25.277749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978e37-6519-4e2f-a935-18d6126f7d23 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:25.309792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c893206-8261-4d55-afe1-a2fe65ec3414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:25.310392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c893206-8261-4d55-afe1-a2fe65ec3414 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:25.310672 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c893206-8261-4d55-afe1-a2fe65ec3414 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:25.310945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c893206-8261-4d55-afe1-a2fe65ec3414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:25.311592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c893206-8261-4d55-afe1-a2fe65ec3414 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:25.312969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c893206-8261-4d55-afe1-a2fe65ec3414 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:25.331950 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 410/821] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:35.172017 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=32 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:35.330200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:27.693586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50569e39-a1d6-4c02-95e9-112e6dc5af9c None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:27.694342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50569e39-a1d6-4c02-95e9-112e6dc5af9c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:27.694342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50569e39-a1d6-4c02-95e9-112e6dc5af9c None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:27.695527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 412/822] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:27.701572 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:27.702133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:27.702264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:27.727197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:27.727197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:27.815633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 411/823] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:02:28.154575 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50569e39-a1d6-4c02-95e9-112e6dc5af9c None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:28.284033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50569e39-a1d6-4c02-95e9-112e6dc5af9c None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:28.322677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:28.323302 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:28.323596 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:28.324558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:28.335031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:28.336642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:28.352718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:28.353804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:28.354802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:28.354802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:28.354802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:28.354802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 413/824] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:28.362411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:28.474936 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f89420-020d-43a9-b5cb-abcfdad97597 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:28.507146 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:28.517814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:28.518431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:28.518800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:28.519145 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:28.519922 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:28.520225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:28.522382 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc977152-c462-4560-9872-a691a1603ab2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:28.547188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 412/825] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:28.553038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:28.618162 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:28.682038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd45c4-6edc-4636-b3f5-08b58cf198c6 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:28.721169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916ad0-7b65-4e8a-b1e1-c877aee3d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:28.722063 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916ad0-7b65-4e8a-b1e1-c877aee3d631 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:28.722246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916ad0-7b65-4e8a-b1e1-c877aee3d631 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:28.722447 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916ad0-7b65-4e8a-b1e1-c877aee3d631 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:28.723196 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916ad0-7b65-4e8a-b1e1-c877aee3d631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:28.724868 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916ad0-7b65-4e8a-b1e1-c877aee3d631 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:28.748808 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 414/826] 10.222.0.78 () {60 vars in 1132 bytes} [Thu Aug 25 03:02:28 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:31.064113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283179-c594-49e6-8876-f829aaa2dc66 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.064723 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283179-c594-49e6-8876-f829aaa2dc66 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.064723 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283179-c594-49e6-8876-f829aaa2dc66 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.065977 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 413/827] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:02:31.071887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.072396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.072507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.091152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:31.092382 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:31.167139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 415/828] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:02:31.519750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283179-c594-49e6-8876-f829aaa2dc66 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:31.633899 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283179-c594-49e6-8876-f829aaa2dc66 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:31.671170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:31.671809 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.672123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.672403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.683433 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:02:31.688508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:31.690139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:31.691605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 414/829] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:31.696789 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:31.743872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:31.815574 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e9854-0e01-48f4-af95-5be466d4c305 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:31.853628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:31.854290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.854595 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.854964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.855671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:31.856018 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:31.857542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:31.866954 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 416/830] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:02:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:31.873019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:31.924485 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:31.988729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975fcc0-449d-4f47-9cc9-2294a7198d23 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:32.025935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:32.026564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.026846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.027117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.038231 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:32.039683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:32.056056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:32.057255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:32.058366 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:32.058366 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:32.058366 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:32.058366 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 415/831] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:32.063481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:32.173955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:32.177848 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f50d1-4405-4ef7-966d-80e78e99621c None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:32.217367 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:32.217977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.218264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.218536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.219173 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:32.219476 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:32.220878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:32.233732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 417/832] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:32.240659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:32.353265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:32.356990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fee3c-2405-4c52-b9e6-4484a262e3a1 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:32.395791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:32.396681 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.397075 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.397528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.406368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:32.408102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:02:32.421031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:32.422194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:32.428846 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 416/833] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:32.429621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:32.540051 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe03fc-e406-4c80-82c8-51bb6ea940d5 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:32.578265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:32.579021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.579301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.579569 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.580327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:32.580631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:32.582118 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:32.606573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 418/834] 10.222.0.78 () {56 vars in 1143 bytes} [Thu Aug 25 03:02:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:32.607717 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:32.718721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c914ce-96f1-4383-8c89-9334e3780239 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:32.754392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:32.755525 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.755525 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.755745 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.792670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:32.840849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:32.842730 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:32.958492 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 417/835] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:02:32 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 03:02:32.967627 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:32.990801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:33.104623 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e5431-7022-4f9c-a511-8506f35f5506 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:33.142271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:33.142904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:33.143327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:33.143471 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:33.157412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:33.157412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:33.183453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:33.185265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:33.186293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:33.186293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:33.186293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:33.186293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 419/836] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:33.193156 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:33.267449 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:33.328964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c95b8-b26e-4985-9e8d-e740710c9de2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:33.373106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:33.373941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:33.374376 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:33.374771 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:33.375513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:33.375979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:33.378451 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:33.394914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 418/837] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:33.401979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:33.482254 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:33.519752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a7eea-7a57-492e-bab2-1da787f8ec07 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:33.557433 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:33.558062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:33.558371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:33.558612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:33.565527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:33.566960 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:02:33.578361 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:33.579711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:33.580919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 420/838] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:33.586220 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:33.712028 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c17d-263c-420f-b1fe-235a60c619d7 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:33.734012 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:33.757216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:33.758568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:33.758568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:33.758767 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:33.759332 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:33.759644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:33.761617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292e9be-13aa-417a-b63b-4e27e9fa3e3b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:33.781520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 419/839] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:33.790079 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:33.909452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39a00c-bf00-4af7-b655-826af524c137 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:33.946882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:33.953959 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:33.954684 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:33.962248 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:33.962590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:33.963354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=896d8a3a5f9a45439eaf17c173e6c202) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:33.963694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:33.965178 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eab516-6faf-4f9b-96ba-cdd77166359c None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:33.975241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 421/840] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:02:33 2022] GET /identity/v3/role_assignments?user.id=896d8a3a5f9a45439eaf17c173e6c202&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:36.348044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be219b9-7fe4-4046-9909-1c4fafc5fbea None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:36.349094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be219b9-7fe4-4046-9909-1c4fafc5fbea None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:36.349094 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be219b9-7fe4-4046-9909-1c4fafc5fbea None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:36.350643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 420/841] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:36.357242 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:36.357717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:36.357820 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:36.377946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:36.379234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:36.454468 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 422/842] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 03:02:36.813478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be219b9-7fe4-4046-9909-1c4fafc5fbea None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:36.931841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be219b9-7fe4-4046-9909-1c4fafc5fbea None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:36.969681 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:36.970336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:36.970624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:36.970903 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:36.983380 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:02:36.989712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:36.991173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:36.992277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 421/843] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:37.004305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:37.121795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3158c-2d35-418a-a678-8219212933c1 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:37.151477 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:37.164482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:37.165171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.165493 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.165790 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.166676 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] RBAC: Adding query filter params (name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:37.166949 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:37.168393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:37.182872 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 423/844] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:37.184216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:37.234334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:37.311670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89541cd-9580-45fa-8c64-b8b486468b79 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:37.350750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:37.351518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.351640 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.351950 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.363470 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:37.365448 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:37.381182 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:37.382306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:37.383444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:37.383444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:37.383444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:37.383444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 422/845] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:37.387804 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:37.508645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142107-33f3-463a-a6a0-9a3e0358e53e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:37.545537 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:37.546193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.546503 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.546784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.547482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:37.547786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:37.549371 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:37.562950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 424/846] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:37.569915 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:37.672153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:37.684775 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361ecc-18ca-43d2-bd3d-4ac3766ffad9 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:37.729596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:37.730209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.730530 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.730808 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.739741 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:37.741840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:02:37.757885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:37.759142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:37.760290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 423/847] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:37.765986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:37.837437 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:37.913378 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb29a2-60cc-4dd7-bee3-7cba9e1b1fa4 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:37.953355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:37.953796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.954127 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.954392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.955133 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:37.955477 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:37.957230 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:37.977337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 425/848] 10.222.0.78 () {56 vars in 1143 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:37.983991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:38.106520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a18a-eb42-413e-be77-c8bf58a641cc None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.146272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.146907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.147232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.147520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.162184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.163633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:38.179009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:38.180237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:38.181661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:38.181661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:38.181661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:38.181661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 424/849] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:38.185902 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:38.311486 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11131eda-30be-4db8-b704-1ef29cf2cd69 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.313973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:38.354199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.354864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.355163 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.355509 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.356246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:38.356582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.358107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:38.372699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 426/850] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:38.378831 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:38.382373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:38.497215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48b42-4392-4048-9b7f-9001f262c094 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.534661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.535361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.535590 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.535940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.543450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.545847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:02:38.563321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:38.564613 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:38.565713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 425/851] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:02:38.573724 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:38.694035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8f033-0d9f-4e8c-a35d-a3f8bb66dd16 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.731082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.731685 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.731994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.732264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.732982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:38.733413 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.734841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b6ad-b786-46aa-aec9-24f3c06bd15e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:38.749161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 427/852] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:38.755932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:38.840353 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:38.887475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2536b0d-ba29-46ef-a724-f58fdea00ee8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.924079 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e9ca5-7bbd-43de-b934-e2c79f897f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.924778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e9ca5-7bbd-43de-b934-e2c79f897f02 None admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.925088 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e9ca5-7bbd-43de-b934-e2c79f897f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.925491 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e9ca5-7bbd-43de-b934-e2c79f897f02 None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/896d8a3a5f9a45439eaf17c173e6c202/roles/be90cb2a180e4d96942e089640221a37` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.940999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e9ca5-7bbd-43de-b934-e2c79f897f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=896d8a3a5f9a45439eaf17c173e6c202, role_id=be90cb2a180e4d96942e089640221a37)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.943056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e9ca5-7bbd-43de-b934-e2c79f897f02 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:38.967925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 426/853] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:02:38 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/896d8a3a5f9a45439eaf17c173e6c202/roles/be90cb2a180e4d96942e089640221a37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:41.293690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1dd6a-db37-42cc-bfba-b94d3ec7c1a2 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:41.294294 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1dd6a-db37-42cc-bfba-b94d3ec7c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:41.294294 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1dd6a-db37-42cc-bfba-b94d3ec7c1a2 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:41.295564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 428/854] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:41.300935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:41.301422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:41.301517 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:41.322953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:41.324199 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:41.400365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 427/855] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:41 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:02:41.741347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1dd6a-db37-42cc-bfba-b94d3ec7c1a2 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:41.769553 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:41.863866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1dd6a-db37-42cc-bfba-b94d3ec7c1a2 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:41.903690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:41.904392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:41.904708 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:41.905034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:41.917071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:02:41.922093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:41.923267 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:41.924528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 429/856] 10.222.0.78 () {56 vars in 1102 bytes} [Thu Aug 25 03:02:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:02:41.929877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:41.977546 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:42.042296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a347c9c-a6de-4c17-8bee-c922ff43b4c2 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:42.098037 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:42.098757 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:42.099038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:42.099314 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:42.100021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] RBAC: Adding query filter params (name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:42.100326 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:42.101705 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:42.111289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 428/857] 10.222.0.78 () {56 vars in 1103 bytes} [Thu Aug 25 03:02:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:42.117781 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:42.208944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:42.225092 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778064-1a58-4426-a9b7-c7ecdddda6c0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:42.264495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:42.265196 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:42.265511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:42.265814 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:42.278047 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:42.279801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:42.296246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:42.297807 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:42.298903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:42.298903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:42.298903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:42.298903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 430/858] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:42.303242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:42.411990 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ff57c-2b38-4784-afac-dcc07abe936b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:42.414267 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:42.448558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:42.449317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:42.449738 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:42.450044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:42.450685 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:42.450991 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:42.452524 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:42.466052 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 429/859] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:42.471682 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:42.586720 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849aadd-bf14-44c7-8b02-08a10a8308c9 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:42.622914 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:42.623489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:42.623782 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:42.624089 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:42.626997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:42.633669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:42.635238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:02:42.646431 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:42.647796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:42.649166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 431/860] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:42.653719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:42.770131 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160ccf2-1fd1-400a-afb7-8d1897e4c711 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:42.813298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:42.814030 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:42.814312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:42.814612 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:42.815419 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:42.815725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:42.817532 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:42.837164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 430/861] 10.222.0.78 () {56 vars in 1143 bytes} [Thu Aug 25 03:02:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:42.843212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:42.961890 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2cf13-4a90-4e99-821b-6bf799216a31 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:43.004506 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:43.005110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:43.005389 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:43.005656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:43.077937 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:43.086978 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:43.088591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:43.195411 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 432/862] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:02:42 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 03:02:43.201344 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:43.227183 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:43.316621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484a7a-10ad-4d00-8146-2944ce2d0d8d None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:43.360476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:43.361198 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:43.361516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:43.361847 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:43.374660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:43.376434 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:43.394774 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:43.396500 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:43.397422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:43.397422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:43.397422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:43.397422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 431/863] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:43.403193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:43.511071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:43.518423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4efc-51d7-46f2-9282-af2795fb4d91 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:43.557278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:43.558001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:43.558306 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:43.558607 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:43.559319 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:43.559643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:43.561219 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:43.579631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 433/864] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:43.581118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:43.672705 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:43.702608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9228fe9-4265-4b6d-a7af-e671c32b1bde None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:43.740868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:43.741490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:43.741778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:43.742054 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:43.750086 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:43.751718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:02:43.765041 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:43.766170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:43.767281 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 432/865] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:02:43.774145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:43.902121 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c0af7-59c2-481c-99fb-369db86cdd95 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:43.939566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:43.940133 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:43.940424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:43.940693 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:43.941376 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:43.941677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:43.943651 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef059d1-5c04-41a4-b403-81f6b7ca4c1d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:43.958261 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 434/866] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:43.964505 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:44.098233 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bc7f8-2a14-4394-b896-fa23b88da68a None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:44.147956 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:44.148604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:44.148893 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:44.149186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:44.149970 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] RBAC: Adding query filter params (role.id=be90cb2a180e4d96942e089640221a37, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=896d8a3a5f9a45439eaf17c173e6c202) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:44.150403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:44.152332 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af8c7e-f800-4cab-85b0-9a91c80e53aa None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:44.154701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:44.160884 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 433/867] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:02:43 2022] GET /identity/v3/role_assignments?user.id=896d8a3a5f9a45439eaf17c173e6c202&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=be90cb2a180e4d96942e089640221a37 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:46.876628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c3b7-6843-45ea-8153-f439808d0142 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.877172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c3b7-6843-45ea-8153-f439808d0142 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.877172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c3b7-6843-45ea-8153-f439808d0142 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.878669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 435/868] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:46.884872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351e573-e52a-4829-897f-a285a8477919 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.885602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351e573-e52a-4829-897f-a285a8477919 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.885815 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351e573-e52a-4829-897f-a285a8477919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.906047 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-7351e573-e52a-4829-897f-a285a8477919 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:46.907394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-7351e573-e52a-4829-897f-a285a8477919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.991004 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 434/869] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:02:47.350964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c3b7-6843-45ea-8153-f439808d0142 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:47.372531 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:47.491227 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c3b7-6843-45ea-8153-f439808d0142 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:47.538307 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:47.539363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:47.539879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:47.540379 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:47.554882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:02:47.560788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:47.561783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:47.562657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 436/870] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:47.571799 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351e573-e52a-4829-897f-a285a8477919 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:47.698769 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351e573-e52a-4829-897f-a285a8477919 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:47.732050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:47.742388 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:47.743009 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:47.743387 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:47.743755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:47.744730 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:47.745111 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:47.747457 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:47.758544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 435/871] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:47.765233 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:47.886604 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:47.924664 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb80a74-94c0-44f5-a1cf-5309df5e315f None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:47.968173 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:47.968707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:47.968990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:47.969263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:47.981918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:47.983426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:48.000514 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:48.002482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:48.004241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:48.004241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:48.004241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:48.004241 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 437/872] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 03:02:48.008783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:48.125038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419877-0fc1-4c7e-b41a-3be74c4bb691 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:48.170541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:48.171383 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:48.171706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:48.172032 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:48.172996 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:48.173317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:48.174800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:48.187431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 436/873] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:48.194209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:48.322963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299b67-a21c-48e7-a283-b12f7cde005d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:48.354259 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:48.362731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:48.363383 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:48.363660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:48.364228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:48.373881 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:48.375373 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:02:48.389194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:48.390815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:48.392034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 438/874] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:48.396303 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:48.456091 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:48.513113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5618-5b8c-45ec-ab99-5fc7bd0b7a3b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:48.551935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:48.553055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:48.553327 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:48.553589 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:48.554322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:48.554622 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:48.556088 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:48.575312 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 437/875] 10.222.0.78 () {56 vars in 1143 bytes} [Thu Aug 25 03:02:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:48.581037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:48.689046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048aa87-541d-4e0a-944c-5191bc51083a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:48.725965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:48.726584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:48.726864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:48.727136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:48.792278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:48.809350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:48.811566 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:48.926519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 439/876] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:02:48 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 03:02:48.932014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:49.040783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0cf57-d50d-4808-a988-76a8f44f93ad None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:49.050114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:49.075277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:49.075932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:49.076208 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:49.076477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:49.085995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:49.087417 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:49.101634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:49.102755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:49.103669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:49.103669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:49.103669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:49.103669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 438/877] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:49.108582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:49.197274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:49.210256 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b66d5-98e7-4d22-96d8-3ce42a7f5d3d None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:49.244865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:49.245457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:49.245730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:49.245995 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:49.246624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:49.246924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:49.248300 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:49.258904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 440/878] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:49.264671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:49.363489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3574a-20a6-4f9f-b282-9effec421e4c None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:49.397174 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:49.397797 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:49.398076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:49.398351 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:49.407019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:49.408410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:02:49.420161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:49.421203 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:49.422269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 439/879] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:49.427293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:49.550521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cf589-7ce0-41cf-a59a-4685478dd421 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:49.585464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:49.586070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:49.586346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:49.586615 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:49.587301 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:49.587605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:49.589061 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708427-3135-48cb-977e-a499bf7f5813 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:49.600953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 441/880] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:49.607382 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:49.633570 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:49.720946 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477769-462e-46d9-ad52-a60076e73e80 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:49.758697 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:49.759299 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:49.759577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:49.759901 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:49.760639 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=896d8a3a5f9a45439eaf17c173e6c202) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:49.760947 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:49.762382 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d178-4614-4fcc-940d-8d27107a407a None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:49.769060 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 440/881] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:02:49 2022] GET /identity/v3/role_assignments?user.id=896d8a3a5f9a45439eaf17c173e6c202&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=7f519a00587a4cb38cff222d59894a29 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:51.990884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9cc7-b143-4cdf-9aa5-8b5f9d8dd461 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:51.991466 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9cc7-b143-4cdf-9aa5-8b5f9d8dd461 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:51.991466 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9cc7-b143-4cdf-9aa5-8b5f9d8dd461 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:51.993364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 442/882] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:51.998609 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:51.999029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:51.999149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.017660 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:52.018873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:52.089935 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 441/883] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:02:52.417087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9cc7-b143-4cdf-9aa5-8b5f9d8dd461 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:52.428784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:52.525255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9cc7-b143-4cdf-9aa5-8b5f9d8dd461 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:52.564315 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:52.564962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:52.565244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:52.565543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.576069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:02:52.580657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:52.582028 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:52.583403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 443/884] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:02:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:52.588804 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:52.604420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:52.689568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcf359-c33c-44e0-a217-c28c24e9d33e None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:52.722930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:52.723529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:52.723806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:52.724631 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.725290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:52.725594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:52.727023 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:52.735210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 442/885] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:02:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:52.741866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:52.818601 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:52.851681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bff35-c592-4ccc-bf86-2ece3964b583 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:52.885403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:52.886016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:52.886348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:52.886557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.897152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:52.898583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:52.913193 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:52.914438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:52.915784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:52.915784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:52.915784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:52.915784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 444/886] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:52.920085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:52.997365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:53.020049 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535221b-aa92-4051-a92f-1eb641fa8a92 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.053214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.053811 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.054090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.054362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.054996 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:53.055300 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.056686 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.068079 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 443/887] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:53.074453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.172529 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662a53e-e5c4-48c2-af18-89cb7ab3534a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.192406 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:53.211271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.211952 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.212230 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.212500 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.220290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.221731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:02:53.233686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:53.234815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:53.235784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 445/888] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:53.241435 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.342478 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b8977-2cc8-48db-98e6-d3cdf52f8165 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.378120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.378751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.379027 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.379300 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.380081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:53.380884 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.382353 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.385360 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:53.402186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 444/889] 10.222.0.78 () {56 vars in 1143 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:53.408175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.517224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb762f6d-5007-4ed4-8f27-e29f480725d0 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.552222 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.552862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.553138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.553407 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.564987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.566464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:53.582005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:53.583244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:53.584865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:53.584865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:53.584865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:53.584865 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 446/890] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:53.589677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.690788 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fec8-5893-4246-89c2-80d8ed3f5ae2 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.727545 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.728198 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.728481 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.728756 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.729407 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:53.729712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.731109 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.744386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 445/891] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:53.750113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.790689 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:53.866850 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1c35-2240-4019-b12f-8b3b4ccefec9 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.904001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.904905 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.905324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.905730 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.915613 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.918088 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:02:53.936805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:53.937864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:53.938883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 447/892] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:53.945447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:54.000539 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:54.050914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69173efb-6812-4a3c-a77a-5e7923454497 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:54.096886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:54.097510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:54.097788 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:54.098059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:54.098763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:54.099558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:54.101070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2648-7d8c-48fa-ae1a-4e277c599703 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:54.116237 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 446/893] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:54.122929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:54.237468 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:54.248620 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e8cf-21a8-44de-b552-7b6ea4585e7e None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:54.283848 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8f20-f543-4fd9-9ee5-164d358f07a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:54.284584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8f20-f543-4fd9-9ee5-164d358f07a2 None admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:54.284880 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8f20-f543-4fd9-9ee5-164d358f07a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:54.285180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8f20-f543-4fd9-9ee5-164d358f07a2 None admin] PATH_INFO: `/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/896d8a3a5f9a45439eaf17c173e6c202/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:54.287896 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8f20-f543-4fd9-9ee5-164d358f07a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d18c854b84c7fa25282ca164abd80, user_id=896d8a3a5f9a45439eaf17c173e6c202, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:54.289375 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8f20-f543-4fd9-9ee5-164d358f07a2 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:54.305332 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 448/894] 10.222.0.78 () {58 vars in 1439 bytes} [Thu Aug 25 03:02:54 2022] PUT /identity/v3/projects/7b5d18c854b84c7fa25282ca164abd80/users/896d8a3a5f9a45439eaf17c173e6c202/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:56.516523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875d2a-4c85-4796-9ed2-6385dab597b4 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:56.517050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875d2a-4c85-4796-9ed2-6385dab597b4 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:56.517050 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875d2a-4c85-4796-9ed2-6385dab597b4 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:56.518390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 447/895] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:56.524271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:56.524698 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:56.524821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:56.543860 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:56.545104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:56.616598 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 449/896] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:02:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:02:56.954138 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875d2a-4c85-4796-9ed2-6385dab597b4 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.062242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875d2a-4c85-4796-9ed2-6385dab597b4 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.077529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:57.098160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.098800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.099082 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.099914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.110466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 03:02:57.116063 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:57.117213 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:57.118089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 448/897] 10.222.0.78 () {56 vars in 1096 bytes} [Thu Aug 25 03:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:57.123289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.206033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:57.225802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86eec-53cf-4de2-b69a-10618f1268f9 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.261544 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.262086 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.262366 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.262639 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.263312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:57.263614 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:57.265037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:57.274128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 450/898] 10.222.0.78 () {56 vars in 1099 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:57.280296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.384842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393e1e1-ae93-4d54-a38b-b71cd07f33b8 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.418908 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.419538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.419851 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.420129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.430143 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:57.431574 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:57.445671 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:57.446824 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:57.448207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:57.448207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:57.448207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:57.448207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 449/899] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:57.452742 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.568737 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e458d2-a951-4b89-b033-e3cd74e3a928 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.603646 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.604281 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.604564 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.604838 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.605481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:57.605786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:57.607142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:57.619703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 451/900] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:57.625720 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.654446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:57.731775 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fdc91-1eb4-4f69-8f29-7326153edd8b None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.767296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.768190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.768549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.768832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.778133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:57.779740 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 03:02:57.792951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:57.794114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:02:57.795096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 450/901] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:57.799972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.803778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:57.902058 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507c92b-84f2-4190-bbe3-f2d9f8c5f5bc None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.937314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.937917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.938194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.938461 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.939176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:57.939480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:57.940942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:57.958617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 452/902] 10.222.0.78 () {56 vars in 1143 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:57.964940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:58.050164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:58.064823 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95808-90a8-444c-85bd-ebfa009a5138 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:58.098870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:58.099474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:58.099750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:58.100055 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:58.169023 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:58.170401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:58.261833 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:58.284154 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 451/903] 10.222.0.78 () {58 vars in 1282 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 03:02:58.291436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:58.368190 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:58.411268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac19a71-91a6-493d-9c8f-8fdd80cb6e8a None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:58.449770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:58.450327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:58.450614 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:58.450886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:58.463438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:58.464977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 03:02:58.482050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:58.484548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 03:02:58.486621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 03:02:58.486621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 03:02:58.486621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:58.486621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 453/904] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:58.491663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:58.637556 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932f1ff-f337-4c88-b67e-5021a5b7f911 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:58.672592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:58.673197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:58.673474 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:58.673753 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:58.674394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:58.674699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:58.676093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:58.688059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 452/905] 10.222.0.78 () {56 vars in 1109 bytes} [Thu Aug 25 03:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:58.693943 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:58.801809 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7cd0f-89d5-4107-b961-0688c82bd9dc None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:58.816349 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:58.836941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:58.837565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:58.837844 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:58.838113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:58.844941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:58.846375 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 03:02:58.857990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application with Lock( Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:02:58.859139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: ERROR keystone.server.flask.application Aug 25 03:02:58.860495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 454/906] 10.222.0.78 () {56 vars in 1111 bytes} [Thu Aug 25 03:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:02:58.866172 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:58.915623 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:58.971645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53ac13-b376-41f7-a6ec-79b670127a3f None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:59.007829 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:59.008518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:59.008842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:59.009159 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:59.009905 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:59.010247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:59.011719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a013173-a47d-4578-90b0-8a4852bad04b None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:59.024683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 453/907] 10.222.0.78 () {56 vars in 1148 bytes} [Thu Aug 25 03:02:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:59.030922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:59.135038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9cb2-7012-4096-bea3-fdd7440acbaa None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:59.191642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:59.192289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:59.192569 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:59.192837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:59.193571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] RBAC: Adding query filter params (role.id=7f519a00587a4cb38cff222d59894a29, scope.project.id=7b5d18c854b84c7fa25282ca164abd80, user.id=896d8a3a5f9a45439eaf17c173e6c202) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:59.193871 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:59.195444 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43c5c4-bd2d-4d1a-ad5d-9dac89562ea8 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:59.201894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 455/908] 10.222.0.78 () {56 vars in 1374 bytes} [Thu Aug 25 03:02:59 2022] GET /identity/v3/role_assignments?user.id=896d8a3a5f9a45439eaf17c173e6c202&scope.project.id=7b5d18c854b84c7fa25282ca164abd80&role.id=7f519a00587a4cb38cff222d59894a29 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:03:01.439608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c52e-bbaf-4418-b3fc-24c3d025a1ad None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:01.440153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c52e-bbaf-4418-b3fc-24c3d025a1ad None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:01.440275 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779c52e-bbaf-4418-b3fc-24c3d025a1ad None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:01.441540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 454/909] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:01.447406 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:01.447852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:01.447986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:01.465543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:01.466716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:01.496522 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:01.533616 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 456/910] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:03:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:03:01.871439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c52e-bbaf-4418-b3fc-24c3d025a1ad None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:01.969289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779c52e-bbaf-4418-b3fc-24c3d025a1ad None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:01.976987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:02.003479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.004142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.004418 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.004691 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.005273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.006628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:03:02.015090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:03:02.016403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:02.017544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 455/911] 10.222.0.78 () {56 vars in 1117 bytes} [Thu Aug 25 03:03:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:03:02.022716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.119287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22d2f3-5018-4a0e-83f1-1e1658d10f97 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.153793 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.154320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.154595 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.154864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.155482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:02.155781 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.157167 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726bd97-045d-4b4a-83c8-87c6fb548111 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.161830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 457/912] 10.222.0.78 () {56 vars in 1116 bytes} [Thu Aug 25 03:03:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:02.167630 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.265239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5858a5c-84a7-4fd5-82b7-1a28e47659eb None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.297278 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.297923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.298207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.298479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] PATH_INFO: `/v3/services` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.299092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] RBAC: Adding query filter params (type=placement) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:02.299393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.300758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082292a-8dbf-46fe-9406-7957ee8ccccd None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.305684 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 456/913] 10.222.0.78 () {56 vars in 1116 bytes} [Thu Aug 25 03:03:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:04.518412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b5be-b734-48d8-a6c4-ce4983e22ae5 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:04.518968 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b5be-b734-48d8-a6c4-ce4983e22ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:04.518968 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b5be-b734-48d8-a6c4-ce4983e22ae5 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:04.520291 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 458/914] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:04.525659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb7775-769d-4568-80a0-12f30347a5ca None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:04.526086 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb7775-769d-4568-80a0-12f30347a5ca None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:04.526196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb7775-769d-4568-80a0-12f30347a5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:04.544727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-85fb7775-769d-4568-80a0-12f30347a5ca None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:04.545902 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-85fb7775-769d-4568-80a0-12f30347a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:04.572294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:04.611394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 457/915] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:03:04 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:03:04.953635 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b5be-b734-48d8-a6c4-ce4983e22ae5 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:04.985248 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:05.058076 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b5be-b734-48d8-a6c4-ce4983e22ae5 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:05.091038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688b45b-de61-4b9a-91fd-d9618b7e3445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:05.091666 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688b45b-de61-4b9a-91fd-d9618b7e3445 None admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:05.091992 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688b45b-de61-4b9a-91fd-d9618b7e3445 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:05.092354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688b45b-de61-4b9a-91fd-d9618b7e3445 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:05.092994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688b45b-de61-4b9a-91fd-d9618b7e3445 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:05.094345 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688b45b-de61-4b9a-91fd-d9618b7e3445 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:05.109424 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 459/916] 10.222.0.78 () {60 vars in 1141 bytes} [Thu Aug 25 03:03:04 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:07.259638 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39425d-0ed2-43a0-9c6d-fc3da20cfedf None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.260210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39425d-0ed2-43a0-9c6d-fc3da20cfedf None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.260304 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39425d-0ed2-43a0-9c6d-fc3da20cfedf None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.261580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 458/917] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:07.266989 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.267405 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.267538 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.286232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:07.288113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:07.366748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 460/918] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:03:07 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:03:07.692896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39425d-0ed2-43a0-9c6d-fc3da20cfedf None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:07.793772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39425d-0ed2-43a0-9c6d-fc3da20cfedf None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:07.833834 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:07.834484 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.834764 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.835043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.835624 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:07.837022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:03:07.845700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:03:07.846877 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:07.847758 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 459/919] 10.222.0.78 () {56 vars in 1117 bytes} [Thu Aug 25 03:03:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:03:07.853633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:07.872327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:07.952014 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e833a-0274-4f72-b62a-91ab9d95fc23 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:07.985442 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:07.986045 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.986321 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.986594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.987215 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:07.987516 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:07.988910 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:07.994110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 461/920] 10.222.0.78 () {56 vars in 1116 bytes} [Thu Aug 25 03:03:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:08.000128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:08.028396 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:08.096953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff082de1-429c-4259-a0e7-dfbd58694357 None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:08.129543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:08.130068 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:08.130464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:08.130738 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:08.131326 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] RBAC: Adding query filter params (interface=public, service_id=38ae122be9124afe86a36e0ee4c308a4, region_id=RegionOne) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:08.131633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:08.133022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca63c-7dee-4ade-8f08-96dc0a51f3af None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:08.137906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 460/921] 10.222.0.78 () {56 vars in 1251 bytes} [Thu Aug 25 03:03:07 2022] GET /identity/v3/endpoints?service_id=38ae122be9124afe86a36e0ee4c308a4&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:08.143781 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:08.223645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:08.242046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36e75-e162-42e0-b91a-95e0fb7a6556 None admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:08.275108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7632cd-201c-4072-9a98-6154deb63cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:08.275698 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7632cd-201c-4072-9a98-6154deb63cab None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:08.276008 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7632cd-201c-4072-9a98-6154deb63cab None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:08.276283 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7632cd-201c-4072-9a98-6154deb63cab None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:08.276876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7632cd-201c-4072-9a98-6154deb63cab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:08.278229 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7632cd-201c-4072-9a98-6154deb63cab None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:08.284596 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 462/922] 10.222.0.78 () {56 vars in 1087 bytes} [Thu Aug 25 03:03:08 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:10.453417 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a8bf-91fe-49bd-954e-bee9215ceee7 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:10.453987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a8bf-91fe-49bd-954e-bee9215ceee7 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:10.453987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a8bf-91fe-49bd-954e-bee9215ceee7 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:10.455249 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 461/923] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:10.460356 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:10.460757 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:10.460913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:10.479076 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:10.480304 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:10.545830 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 463/924] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:03:10 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 03:03:10.868277 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a8bf-91fe-49bd-954e-bee9215ceee7 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:10.958269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:10.968698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a8bf-91fe-49bd-954e-bee9215ceee7 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:11.002724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:11.003342 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:11.003621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:11.003923 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:11.004596 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:11.005865 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 03:03:11.014796 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 03:03:11.016019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application with Lock( Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self._enter() Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application return self.creator() Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application created_value = creator( Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: ERROR keystone.server.flask.application Aug 25 03:03:11.016933 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 462/925] 10.222.0.78 () {56 vars in 1117 bytes} [Thu Aug 25 03:03:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 03:03:11.022594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:11.101653 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:11.124070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653941-eef3-4f1b-ad30-b28646f7b2b6 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:11.156291 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:11.156881 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:11.157156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:11.157425 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] PATH_INFO: `/v3/services` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:11.158037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:11.158335 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:11.159688 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4061c-4425-4fa0-b039-8e8d08b6f34e None admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:11.165355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 464/926] 10.222.0.78 () {56 vars in 1116 bytes} [Thu Aug 25 03:03:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:11.171085 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:11.267133 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71f80-fe0e-41b4-8dcf-0cbd3857dc2e None admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:11.298978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a3f8a-2fd8-4970-b68b-d9f33ad71c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:11.299598 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a3f8a-2fd8-4970-b68b-d9f33ad71c32 None admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:11.299906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a3f8a-2fd8-4970-b68b-d9f33ad71c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:11.300180 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a3f8a-2fd8-4970-b68b-d9f33ad71c32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:11.300840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a3f8a-2fd8-4970-b68b-d9f33ad71c32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:11.302192 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a3f8a-2fd8-4970-b68b-d9f33ad71c32 None admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:11.323216 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 463/927] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:21.161863 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=30 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:21.318081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:13.397911 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881d20-a7ae-4137-a8a8-182d08096939 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:13.398516 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881d20-a7ae-4137-a8a8-182d08096939 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:13.398516 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881d20-a7ae-4137-a8a8-182d08096939 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:13.400638 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 465/928] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:04:13.406361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ddb19-9971-4737-a69f-051d9ba8afeb None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:13.406928 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ddb19-9971-4737-a69f-051d9ba8afeb None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:13.406928 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ddb19-9971-4737-a69f-051d9ba8afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:13.428751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b93ddb19-9971-4737-a69f-051d9ba8afeb None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:13.429888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b93ddb19-9971-4737-a69f-051d9ba8afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:13.530714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 464/929] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:04:13.888493 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcb6a-9291-4006-ac29-49b06db60f8c None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:13.889221 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcb6a-9291-4006-ac29-49b06db60f8c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:13.889496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcb6a-9291-4006-ac29-49b06db60f8c None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:13.891334 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 466/930] 10.222.0.78 () {54 vars in 965 bytes} [Thu Aug 25 03:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:13.898713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd693-37d8-4a3a-aac9-e492cadb192b None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:13.899307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd693-37d8-4a3a-aac9-e492cadb192b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:13.899802 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd693-37d8-4a3a-aac9-e492cadb192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:13.960696 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-66ecd693-37d8-4a3a-aac9-e492cadb192b None None] MFA Rules not processed for user `4fab6f04a71044c8a5c16944dc5fb349`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:13.961945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-66ecd693-37d8-4a3a-aac9-e492cadb192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:14.041043 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 465/931] 10.222.0.78 () {58 vars in 1062 bytes} [Thu Aug 25 03:04:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:14.050401 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcb6a-9291-4006-ac29-49b06db60f8c None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:14.062822 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcb6a-9291-4006-ac29-49b06db60f8c None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:14.068482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07b60d-9567-4df5-86d0-0aa5fe443a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:14.069577 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07b60d-9567-4df5-86d0-0aa5fe443a85 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:14.070176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07b60d-9567-4df5-86d0-0aa5fe443a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:14.071400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07b60d-9567-4df5-86d0-0aa5fe443a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:14.083928 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07b60d-9567-4df5-86d0-0aa5fe443a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:14.085689 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07b60d-9567-4df5-86d0-0aa5fe443a85 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:14.099409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 467/932] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:04:16.820201 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55305a0-d7df-4951-bb19-70cc8f2b61de None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:16.821738 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55305a0-d7df-4951-bb19-70cc8f2b61de None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:16.822140 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55305a0-d7df-4951-bb19-70cc8f2b61de None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:16.823713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 466/933] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:16.831265 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954427a1-48d7-4001-9951-596313df2471 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:16.831767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954427a1-48d7-4001-9951-596313df2471 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:16.831767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954427a1-48d7-4001-9951-596313df2471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:16.855697 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-954427a1-48d7-4001-9951-596313df2471 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:16.856983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-954427a1-48d7-4001-9951-596313df2471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:16.868668 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 468/934] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:17.234416 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45429d-03b1-46e1-827e-61d753d18cd8 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:17.234852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45429d-03b1-46e1-827e-61d753d18cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:17.235264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45429d-03b1-46e1-827e-61d753d18cd8 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:17.237322 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 467/935] 10.222.0.78 () {54 vars in 965 bytes} [Thu Aug 25 03:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:17.246103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c90c7-7c4a-45be-901b-245c26afdd91 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:17.246581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c90c7-7c4a-45be-901b-245c26afdd91 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:17.247053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c90c7-7c4a-45be-901b-245c26afdd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:17.278004 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-9c2c90c7-7c4a-45be-901b-245c26afdd91 None None] MFA Rules not processed for user `4fab6f04a71044c8a5c16944dc5fb349`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:17.280012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-9c2c90c7-7c4a-45be-901b-245c26afdd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:17.289425 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 469/936] 10.222.0.78 () {58 vars in 1062 bytes} [Thu Aug 25 03:04:17 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:17.300957 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45429d-03b1-46e1-827e-61d753d18cd8 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:17.324275 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45429d-03b1-46e1-827e-61d753d18cd8 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:17.330469 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507607e9-b909-489c-929f-e00cda7e6ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:17.331191 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507607e9-b909-489c-929f-e00cda7e6ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:17.331555 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507607e9-b909-489c-929f-e00cda7e6ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:17.331943 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507607e9-b909-489c-929f-e00cda7e6ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:17.341984 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507607e9-b909-489c-929f-e00cda7e6ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:17.343534 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507607e9-b909-489c-929f-e00cda7e6ef8 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:17.355233 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 468/937] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:20.536095 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead855-ea91-41e9-839e-33cc33056075 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:20.536624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead855-ea91-41e9-839e-33cc33056075 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:20.536624 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead855-ea91-41e9-839e-33cc33056075 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:20.537985 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 470/938] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:20.543700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b76d-7425-4b12-8a69-6fc8ab5d2f2e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:20.544151 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b76d-7425-4b12-8a69-6fc8ab5d2f2e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:20.544421 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660b76d-7425-4b12-8a69-6fc8ab5d2f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:20.583470 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-0660b76d-7425-4b12-8a69-6fc8ab5d2f2e None None] MFA Rules not processed for user `77ea6e472d944589af922adaecdc29f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:20.584633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-0660b76d-7425-4b12-8a69-6fc8ab5d2f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:20.629529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:20.657456 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 469/939] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:20 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:21.001779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ead855-ea91-41e9-839e-33cc33056075 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:21.013377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ead855-ea91-41e9-839e-33cc33056075 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:21.016824 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d04e6-15d7-4d62-bc20-dd6be9b3f927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:21.017415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d04e6-15d7-4d62-bc20-dd6be9b3f927 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:21.017691 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d04e6-15d7-4d62-bc20-dd6be9b3f927 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:21.017964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d04e6-15d7-4d62-bc20-dd6be9b3f927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:21.028240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d04e6-15d7-4d62-bc20-dd6be9b3f927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:21.029679 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d04e6-15d7-4d62-bc20-dd6be9b3f927 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:21.039403 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 471/940] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:21 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:23.767113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fdad4-4498-48ef-b221-a26c40582e9d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:23.767644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fdad4-4498-48ef-b221-a26c40582e9d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:23.767644 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fdad4-4498-48ef-b221-a26c40582e9d None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:23.768995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 470/941] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:04:23.774440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365482c2-7b8a-4e24-9915-8a6c56379399 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:23.774878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365482c2-7b8a-4e24-9915-8a6c56379399 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:23.775145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365482c2-7b8a-4e24-9915-8a6c56379399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:23.795857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-365482c2-7b8a-4e24-9915-8a6c56379399 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:23.797183 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-365482c2-7b8a-4e24-9915-8a6c56379399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:23.870683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 472/942] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:23 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:24.213325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fdad4-4498-48ef-b221-a26c40582e9d None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:24.224005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fdad4-4498-48ef-b221-a26c40582e9d None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:24.227999 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5e64-156f-4d7f-9f24-c3da89c697e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:24.229120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5e64-156f-4d7f-9f24-c3da89c697e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:24.229120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5e64-156f-4d7f-9f24-c3da89c697e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:24.229120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5e64-156f-4d7f-9f24-c3da89c697e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:24.237844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5e64-156f-4d7f-9f24-c3da89c697e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:24.239271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5e64-156f-4d7f-9f24-c3da89c697e8 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:24.249443 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 471/943] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:24 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:27.142738 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48447-32a6-44a4-a4f4-28407ec77f94 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:27.143312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48447-32a6-44a4-a4f4-28407ec77f94 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:27.143312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48447-32a6-44a4-a4f4-28407ec77f94 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:27.144657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 473/944] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:27.150608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a9909-1ce0-4d7d-a563-391e4cb1fbab None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:27.151129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a9909-1ce0-4d7d-a563-391e4cb1fbab None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:27.151129 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a9909-1ce0-4d7d-a563-391e4cb1fbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:27.171763 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-1d2a9909-1ce0-4d7d-a563-391e4cb1fbab None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:27.173007 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-1d2a9909-1ce0-4d7d-a563-391e4cb1fbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:27.181209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 472/945] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:27.528589 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48447-32a6-44a4-a4f4-28407ec77f94 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:27.539275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48447-32a6-44a4-a4f4-28407ec77f94 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:27.542768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819d06-b942-4f95-8b22-b5812095c330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:27.543364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819d06-b942-4f95-8b22-b5812095c330 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:27.543641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819d06-b942-4f95-8b22-b5812095c330 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:27.543942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819d06-b942-4f95-8b22-b5812095c330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:27.553600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85819d06-b942-4f95-8b22-b5812095c330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:27.555055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85819d06-b942-4f95-8b22-b5812095c330 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:27.565364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 474/946] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:29.820440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a9d0-18e6-41b9-a593-3e432eea2bc1 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:29.821003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a9d0-18e6-41b9-a593-3e432eea2bc1 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:29.821003 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a9d0-18e6-41b9-a593-3e432eea2bc1 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:29.822920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 473/947] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:29.827925 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a306a-d302-44ee-bd3d-5ca9b0fbf79a None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:29.828329 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a306a-d302-44ee-bd3d-5ca9b0fbf79a None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:29.828641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a306a-d302-44ee-bd3d-5ca9b0fbf79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:29.848225 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-e79a306a-d302-44ee-bd3d-5ca9b0fbf79a None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:29.849428 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-e79a306a-d302-44ee-bd3d-5ca9b0fbf79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:29.857346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 475/948] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:30.197204 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460a9d0-18e6-41b9-a593-3e432eea2bc1 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:30.208979 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460a9d0-18e6-41b9-a593-3e432eea2bc1 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:30.213321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390f69-d39b-4267-811e-13269dd68d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:30.213952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390f69-d39b-4267-811e-13269dd68d44 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:30.214230 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390f69-d39b-4267-811e-13269dd68d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:30.214501 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390f69-d39b-4267-811e-13269dd68d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:30.224107 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d390f69-d39b-4267-811e-13269dd68d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:30.225541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d390f69-d39b-4267-811e-13269dd68d44 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:30.235346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 474/949] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:32.478539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46f6a-ce90-4188-89c5-d0f2bc1fb6ee None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:32.479088 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46f6a-ce90-4188-89c5-d0f2bc1fb6ee None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:32.479088 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46f6a-ce90-4188-89c5-d0f2bc1fb6ee None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:32.480587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 476/950] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:32.485656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343015e-aeb7-4e7e-a5fa-407dae0c4160 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:32.486081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343015e-aeb7-4e7e-a5fa-407dae0c4160 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:32.486207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343015e-aeb7-4e7e-a5fa-407dae0c4160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:32.505876 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-c343015e-aeb7-4e7e-a5fa-407dae0c4160 None None] MFA Rules not processed for user `77ea6e472d944589af922adaecdc29f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:32.507084 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-c343015e-aeb7-4e7e-a5fa-407dae0c4160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:32.517194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 475/951] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:32 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:32.863526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46f6a-ce90-4188-89c5-d0f2bc1fb6ee None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:32.874532 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46f6a-ce90-4188-89c5-d0f2bc1fb6ee None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:32.877993 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231c85e-0369-4d19-9827-f7266567a731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:32.878586 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c85e-0369-4d19-9827-f7266567a731 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:32.878866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c85e-0369-4d19-9827-f7266567a731 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:32.879139 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c85e-0369-4d19-9827-f7266567a731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:32.889658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231c85e-0369-4d19-9827-f7266567a731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:32.891105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231c85e-0369-4d19-9827-f7266567a731 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:32.901430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 477/952] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:32 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:35.537187 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97549add-36a3-493f-b0bd-d6ec3f4a9259 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:35.537701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97549add-36a3-493f-b0bd-d6ec3f4a9259 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:35.537701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97549add-36a3-493f-b0bd-d6ec3f4a9259 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:35.538842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 476/953] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:35.544878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179193cf-c6a3-4231-92d7-99a8a2a01172 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:35.545388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179193cf-c6a3-4231-92d7-99a8a2a01172 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:35.545506 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179193cf-c6a3-4231-92d7-99a8a2a01172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:35.565228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-179193cf-c6a3-4231-92d7-99a8a2a01172 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:35.566434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-179193cf-c6a3-4231-92d7-99a8a2a01172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:35.574649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 478/954] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:35.919062 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97549add-36a3-493f-b0bd-d6ec3f4a9259 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:35.931748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97549add-36a3-493f-b0bd-d6ec3f4a9259 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:35.933591 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aee13-2aea-490f-8335-72e72202f5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:35.934180 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aee13-2aea-490f-8335-72e72202f5dc service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:35.934458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aee13-2aea-490f-8335-72e72202f5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:35.934730 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aee13-2aea-490f-8335-72e72202f5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:35.943684 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aee13-2aea-490f-8335-72e72202f5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:35.945139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aee13-2aea-490f-8335-72e72202f5dc service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:35.954827 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 477/955] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:38.388506 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa664-44ce-432d-9416-53bb13325e62 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:38.389071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa664-44ce-432d-9416-53bb13325e62 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:38.389071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa664-44ce-432d-9416-53bb13325e62 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:38.390525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 479/956] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:38.395659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb547d4-0c60-43d1-872d-5fbd159c538c None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:38.396177 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb547d4-0c60-43d1-872d-5fbd159c538c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:38.396273 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb547d4-0c60-43d1-872d-5fbd159c538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:38.415896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-0fb547d4-0c60-43d1-872d-5fbd159c538c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:38.417108 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-0fb547d4-0c60-43d1-872d-5fbd159c538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:38.440275 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 478/957] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:04:38.784681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa664-44ce-432d-9416-53bb13325e62 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:38.795945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa664-44ce-432d-9416-53bb13325e62 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:38.799436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242d688-8b8b-418f-b630-bc512ea0d877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:38.800082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d688-8b8b-418f-b630-bc512ea0d877 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:38.800352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d688-8b8b-418f-b630-bc512ea0d877 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:38.800626 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d688-8b8b-418f-b630-bc512ea0d877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:38.810537 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242d688-8b8b-418f-b630-bc512ea0d877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:38.812069 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242d688-8b8b-418f-b630-bc512ea0d877 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:38.822095 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 480/958] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:41.513602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8406ff2-667a-49a4-8ba1-307239d70c1a None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:41.514190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8406ff2-667a-49a4-8ba1-307239d70c1a None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:41.514190 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8406ff2-667a-49a4-8ba1-307239d70c1a None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:41.515461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 479/959] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:41.520852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f3356-d2f5-4e51-9871-f84f9ac33061 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:41.521348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f3356-d2f5-4e51-9871-f84f9ac33061 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:41.521451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f3356-d2f5-4e51-9871-f84f9ac33061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:41.529526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=74 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:41.542386 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-489f3356-d2f5-4e51-9871-f84f9ac33061 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:41.543590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-489f3356-d2f5-4e51-9871-f84f9ac33061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:41.551686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 481/960] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:41 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:41.903669 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8406ff2-667a-49a4-8ba1-307239d70c1a None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:41.914352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8406ff2-667a-49a4-8ba1-307239d70c1a None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:41.918512 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8eb35-67bd-4fcb-b9d4-0707349024fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:41.919102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8eb35-67bd-4fcb-b9d4-0707349024fe service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:41.919383 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8eb35-67bd-4fcb-b9d4-0707349024fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:41.919656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8eb35-67bd-4fcb-b9d4-0707349024fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:41.928592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8eb35-67bd-4fcb-b9d4-0707349024fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:41.930029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8eb35-67bd-4fcb-b9d4-0707349024fe service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:41.939361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 480/961] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:41 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:46.151699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087236a7-40be-4659-88e6-fb4eab0b4ab9 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:46.152269 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087236a7-40be-4659-88e6-fb4eab0b4ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:46.152269 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087236a7-40be-4659-88e6-fb4eab0b4ab9 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:46.153547 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 482/962] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:46.158718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a839e0c-41de-4b09-b95b-6d6b26095505 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:46.159112 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a839e0c-41de-4b09-b95b-6d6b26095505 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:46.159403 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a839e0c-41de-4b09-b95b-6d6b26095505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:46.179262 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-0a839e0c-41de-4b09-b95b-6d6b26095505 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:46.180491 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-0a839e0c-41de-4b09-b95b-6d6b26095505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:46.188242 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 481/963] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:46.530521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087236a7-40be-4659-88e6-fb4eab0b4ab9 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:46.541539 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087236a7-40be-4659-88e6-fb4eab0b4ab9 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:46.544990 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc848fc-cb95-4394-84b1-1dfaff61375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:46.545583 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc848fc-cb95-4394-84b1-1dfaff61375b service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:46.545860 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc848fc-cb95-4394-84b1-1dfaff61375b service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:46.546131 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc848fc-cb95-4394-84b1-1dfaff61375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:46.556286 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc848fc-cb95-4394-84b1-1dfaff61375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:46.557744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc848fc-cb95-4394-84b1-1dfaff61375b service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:46.568388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 483/964] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:49.435558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c1996-9808-411b-b392-0e0e0615e9e9 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:49.436170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c1996-9808-411b-b392-0e0e0615e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:49.436170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c1996-9808-411b-b392-0e0e0615e9e9 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:49.438127 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 482/965] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:49.444104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead934b-b2cd-4226-afb3-265bf0818ad8 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:49.444543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead934b-b2cd-4226-afb3-265bf0818ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:49.444650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead934b-b2cd-4226-afb3-265bf0818ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:49.464312 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-6ead934b-b2cd-4226-afb3-265bf0818ad8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:49.465654 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-6ead934b-b2cd-4226-afb3-265bf0818ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:49.475368 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 484/966] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:49 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:49.840355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c1996-9808-411b-b392-0e0e0615e9e9 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:49.851883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c1996-9808-411b-b392-0e0e0615e9e9 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:49.855880 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef41ac-ee59-4c78-aaf2-389a1b3c6969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:49.856484 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef41ac-ee59-4c78-aaf2-389a1b3c6969 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:49.856766 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef41ac-ee59-4c78-aaf2-389a1b3c6969 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:49.857042 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef41ac-ee59-4c78-aaf2-389a1b3c6969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:49.867424 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef41ac-ee59-4c78-aaf2-389a1b3c6969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:49.869401 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef41ac-ee59-4c78-aaf2-389a1b3c6969 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:49.879518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 483/967] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:49 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:54.442470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85822d1-daa9-4c09-adb5-ad9c0b41df53 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:54.442994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85822d1-daa9-4c09-adb5-ad9c0b41df53 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:54.442994 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85822d1-daa9-4c09-adb5-ad9c0b41df53 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:54.444462 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 485/968] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:54.449891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77edb-034d-443b-9eff-67eba9841f17 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:54.450343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77edb-034d-443b-9eff-67eba9841f17 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:54.450447 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77edb-034d-443b-9eff-67eba9841f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:54.457713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=54 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:54.471106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5ed77edb-034d-443b-9eff-67eba9841f17 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:54.472325 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5ed77edb-034d-443b-9eff-67eba9841f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:54.480940 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 484/969] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:04:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:54.835377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85822d1-daa9-4c09-adb5-ad9c0b41df53 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:54.847259 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85822d1-daa9-4c09-adb5-ad9c0b41df53 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:54.851114 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a986c11-5dd5-4e65-b91b-f713a2ea1563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:54.851965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986c11-5dd5-4e65-b91b-f713a2ea1563 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:54.852596 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986c11-5dd5-4e65-b91b-f713a2ea1563 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:54.853021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986c11-5dd5-4e65-b91b-f713a2ea1563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:54.862601 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a986c11-5dd5-4e65-b91b-f713a2ea1563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:54.864175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a986c11-5dd5-4e65-b91b-f713a2ea1563 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:54.874964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 486/970] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:00.990479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77eb8-ffbe-49be-a316-0f089c396a2c None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:00.990479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77eb8-ffbe-49be-a316-0f089c396a2c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:00.990479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77eb8-ffbe-49be-a316-0f089c396a2c None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:00.990479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 485/971] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:00.997422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068a4f0-4ec7-4fa3-a08b-95a2dd379764 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:00.997903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068a4f0-4ec7-4fa3-a08b-95a2dd379764 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:00.997982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068a4f0-4ec7-4fa3-a08b-95a2dd379764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:01.135639 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4068a4f0-4ec7-4fa3-a08b-95a2dd379764 None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:01.137575 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4068a4f0-4ec7-4fa3-a08b-95a2dd379764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:01.259660 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 487/972] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:05:00 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:04.466304 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=2 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:06.138832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b8a9-3015-4397-a7af-79e7634f8c70 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:06.139914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b8a9-3015-4397-a7af-79e7634f8c70 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:06.139914 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b8a9-3015-4397-a7af-79e7634f8c70 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:06.140723 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 486/973] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:06.145819 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0401b5-b1ad-4c2e-8f6c-d54cacb35cde None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:06.146256 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0401b5-b1ad-4c2e-8f6c-d54cacb35cde None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:06.146526 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0401b5-b1ad-4c2e-8f6c-d54cacb35cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:06.169146 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-ae0401b5-b1ad-4c2e-8f6c-d54cacb35cde None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:06.170757 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-ae0401b5-b1ad-4c2e-8f6c-d54cacb35cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:06.183911 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 488/974] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:05:06 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:08.202065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4bbb-ec51-4055-817d-7772e73cba79 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:08.202871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4bbb-ec51-4055-817d-7772e73cba79 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:08.202871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4bbb-ec51-4055-817d-7772e73cba79 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:08.203807 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 487/975] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:05:08.209093 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5983-6c1c-4c36-91e0-71e91c327497 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:08.209734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5983-6c1c-4c36-91e0-71e91c327497 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:08.209734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd5983-6c1c-4c36-91e0-71e91c327497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:08.232098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-d2cd5983-6c1c-4c36-91e0-71e91c327497 None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:08.233293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-d2cd5983-6c1c-4c36-91e0-71e91c327497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:08.246021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 489/976] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:05:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:12.083780 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d17e-5d6a-4799-9514-7225f0004924 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:12.084755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d17e-5d6a-4799-9514-7225f0004924 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:12.084755 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d17e-5d6a-4799-9514-7225f0004924 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:12.086437 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 488/977] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:12.094591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043b264-4dc1-434b-9bd7-f090bb9b2219 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:12.095784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043b264-4dc1-434b-9bd7-f090bb9b2219 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:12.096521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043b264-4dc1-434b-9bd7-f090bb9b2219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:12.106418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=63 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:12.137979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4043b264-4dc1-434b-9bd7-f090bb9b2219 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:12.139746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4043b264-4dc1-434b-9bd7-f090bb9b2219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:12.152396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 490/978] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:12.564414 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5d63-923a-41a3-a23c-5045189a886e None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:12.565136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5d63-923a-41a3-a23c-5045189a886e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:12.565784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5d63-923a-41a3-a23c-5045189a886e None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:12.567714 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 489/979] 10.222.0.78 () {54 vars in 962 bytes} [Thu Aug 25 03:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:05:12.577565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784ac9-bf10-479e-a2af-0becc6855dcb None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:12.577983 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784ac9-bf10-479e-a2af-0becc6855dcb None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:12.578383 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784ac9-bf10-479e-a2af-0becc6855dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:12.627480 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-7e784ac9-bf10-479e-a2af-0becc6855dcb None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:12.628748 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-7e784ac9-bf10-479e-a2af-0becc6855dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:12.732251 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 491/980] 10.222.0.78 () {58 vars in 1059 bytes} [Thu Aug 25 03:05:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:12.740625 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f5d63-923a-41a3-a23c-5045189a886e None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:12.756822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f5d63-923a-41a3-a23c-5045189a886e None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:12.764583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba110d8b-0128-46d7-9d3c-ec75d7b7cbce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:12.765540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110d8b-0128-46d7-9d3c-ec75d7b7cbce service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:12.766002 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110d8b-0128-46d7-9d3c-ec75d7b7cbce service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:12.766464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110d8b-0128-46d7-9d3c-ec75d7b7cbce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:12.781891 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110d8b-0128-46d7-9d3c-ec75d7b7cbce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:12.784836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110d8b-0128-46d7-9d3c-ec75d7b7cbce service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:12.802038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 490/981] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:05:16.012605 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c18a-b749-428f-aa82-3afeff18ee5c None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:16.013142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c18a-b749-428f-aa82-3afeff18ee5c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:16.013142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c18a-b749-428f-aa82-3afeff18ee5c None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:16.015293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 492/982] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:16.023114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfbb0b-7d43-417d-85bc-3df2f2234c0f None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:16.025765 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfbb0b-7d43-417d-85bc-3df2f2234c0f None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:16.025765 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfbb0b-7d43-417d-85bc-3df2f2234c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:16.053014 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-4cbfbb0b-7d43-417d-85bc-3df2f2234c0f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:16.054868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-4cbfbb0b-7d43-417d-85bc-3df2f2234c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:16.066406 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 491/983] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:16.554365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c18a-b749-428f-aa82-3afeff18ee5c None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:16.577824 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c18a-b749-428f-aa82-3afeff18ee5c None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:16.585970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dc673-cefc-46aa-ad47-99a1cd8346cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:16.586982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc673-cefc-46aa-ad47-99a1cd8346cd service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:16.587460 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc673-cefc-46aa-ad47-99a1cd8346cd service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:16.587971 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc673-cefc-46aa-ad47-99a1cd8346cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:16.604020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dc673-cefc-46aa-ad47-99a1cd8346cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:16.606897 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dc673-cefc-46aa-ad47-99a1cd8346cd service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:16.625949 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 493/984] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:20.009928 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2ee10-915a-4123-9108-6ea88735d1d4 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:20.010464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2ee10-915a-4123-9108-6ea88735d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:20.010464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2ee10-915a-4123-9108-6ea88735d1d4 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:20.011674 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 492/985] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:20.017642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7a53-ec91-4d0c-9182-5a1fac883f5c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:20.018360 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7a53-ec91-4d0c-9182-5a1fac883f5c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:20.018360 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7a53-ec91-4d0c-9182-5a1fac883f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:20.038917 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-975e7a53-ec91-4d0c-9182-5a1fac883f5c None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:20.041364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-975e7a53-ec91-4d0c-9182-5a1fac883f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:20.053779 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 494/986] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:20.475800 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3522ece-4b28-4eb3-85c0-26af38783130 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:20.476268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3522ece-4b28-4eb3-85c0-26af38783130 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:20.476453 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3522ece-4b28-4eb3-85c0-26af38783130 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:20.477879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 493/987] 10.222.0.78 () {54 vars in 962 bytes} [Thu Aug 25 03:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:20.489010 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704f1a-6ed2-4172-b644-778463118816 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:20.489484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704f1a-6ed2-4172-b644-778463118816 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:20.489972 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704f1a-6ed2-4172-b644-778463118816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:20.530074 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-6b704f1a-6ed2-4172-b644-778463118816 None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:20.532237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-6b704f1a-6ed2-4172-b644-778463118816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:20.545883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 495/988] 10.222.0.78 () {58 vars in 1059 bytes} [Thu Aug 25 03:05:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:20.560574 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3522ece-4b28-4eb3-85c0-26af38783130 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:20.590410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3522ece-4b28-4eb3-85c0-26af38783130 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:20.596519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c0b59-1f3b-49dd-8780-0cd03fd42d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:20.598842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c0b59-1f3b-49dd-8780-0cd03fd42d1c service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:20.598842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c0b59-1f3b-49dd-8780-0cd03fd42d1c service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:20.598842 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c0b59-1f3b-49dd-8780-0cd03fd42d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:20.609211 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c0b59-1f3b-49dd-8780-0cd03fd42d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:20.612911 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c0b59-1f3b-49dd-8780-0cd03fd42d1c service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:20.632011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 494/989] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:23.134489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6cb4f-4882-469f-af4a-5d077e029027 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:23.135388 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6cb4f-4882-469f-af4a-5d077e029027 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:23.136012 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6cb4f-4882-469f-af4a-5d077e029027 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:23.143460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83729-4fa8-4a18-bb6d-51b2830c2f56 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:23.144371 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83729-4fa8-4a18-bb6d-51b2830c2f56 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:23.144870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83729-4fa8-4a18-bb6d-51b2830c2f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:23.147724 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 496/990] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:23.166209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-58d83729-4fa8-4a18-bb6d-51b2830c2f56 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:23.167849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-58d83729-4fa8-4a18-bb6d-51b2830c2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:23.188265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 495/991] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:23.542716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6cb4f-4882-469f-af4a-5d077e029027 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:23.564453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6cb4f-4882-469f-af4a-5d077e029027 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:23.570178 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c5179-0d27-459a-8323-8bcc5efdc853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:23.571056 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c5179-0d27-459a-8323-8bcc5efdc853 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:23.572141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c5179-0d27-459a-8323-8bcc5efdc853 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:23.572820 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c5179-0d27-459a-8323-8bcc5efdc853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:23.582765 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c5179-0d27-459a-8323-8bcc5efdc853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:23.585030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c5179-0d27-459a-8323-8bcc5efdc853 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:23.619126 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 497/992] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:24.799209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1ad0-600d-4cef-adf4-c49299d58afd None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.800070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1ad0-600d-4cef-adf4-c49299d58afd None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.800070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1ad0-600d-4cef-adf4-c49299d58afd None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.801098 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 496/993] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:24.808754 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536097e-b10a-43d0-93b4-f2ea1149db7e None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.810440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536097e-b10a-43d0-93b4-f2ea1149db7e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.810440 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536097e-b10a-43d0-93b4-f2ea1149db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.830349 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-9536097e-b10a-43d0-93b4-f2ea1149db7e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:24.831582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-9536097e-b10a-43d0-93b4-f2ea1149db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.840630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 498/994] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:25.584452 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780b9d-e7e1-4169-b968-387ee99c41fd None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.584452 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780b9d-e7e1-4169-b968-387ee99c41fd None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.584452 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780b9d-e7e1-4169-b968-387ee99c41fd None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.586749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 497/995] 10.222.0.78 () {54 vars in 964 bytes} [Thu Aug 25 03:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:25.591964 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d0cc5-6c86-4f12-bf14-037c40d2e73b None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.592833 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d0cc5-6c86-4f12-bf14-037c40d2e73b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.592833 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d0cc5-6c86-4f12-bf14-037c40d2e73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.643584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-d29d0cc5-6c86-4f12-bf14-037c40d2e73b None None] MFA Rules not processed for user `f930d1296fbe4539b3cdb2a292b48604`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:25.644939 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-d29d0cc5-6c86-4f12-bf14-037c40d2e73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:25.728452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 499/996] 10.222.0.78 () {58 vars in 1061 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:25.736175 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780b9d-e7e1-4169-b968-387ee99c41fd None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.754031 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780b9d-e7e1-4169-b968-387ee99c41fd None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.760038 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b49ce-c2f7-4a80-8afe-ad9b49068084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f930d1296fbe4539b3cdb2a292b48604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.761206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b49ce-c2f7-4a80-8afe-ad9b49068084 service cinder] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.761578 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b49ce-c2f7-4a80-8afe-ad9b49068084 service cinder] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.761992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b49ce-c2f7-4a80-8afe-ad9b49068084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.773952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b49ce-c2f7-4a80-8afe-ad9b49068084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.776759 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b49ce-c2f7-4a80-8afe-ad9b49068084 service cinder] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.789662 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 498/997] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:26.345352 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00040dd3-dc81-4142-a03f-c70daa0a8b3e None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.346043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00040dd3-dc81-4142-a03f-c70daa0a8b3e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.346043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00040dd3-dc81-4142-a03f-c70daa0a8b3e None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.353975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e595317-0c37-415d-b23d-3e5e98d77e52 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.355011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e595317-0c37-415d-b23d-3e5e98d77e52 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.355351 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e595317-0c37-415d-b23d-3e5e98d77e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.357891 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 500/998] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:26.376608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-3e595317-0c37-415d-b23d-3e5e98d77e52 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:26.377832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-3e595317-0c37-415d-b23d-3e5e98d77e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:26.386260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 499/999] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:26.773340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00040dd3-dc81-4142-a03f-c70daa0a8b3e None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:26.793572 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00040dd3-dc81-4142-a03f-c70daa0a8b3e None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.804006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b9dd-3872-40d5-8e24-98398c955a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.804767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b9dd-3872-40d5-8e24-98398c955a85 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.805089 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b9dd-3872-40d5-8e24-98398c955a85 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.805442 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b9dd-3872-40d5-8e24-98398c955a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.815306 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b9dd-3872-40d5-8e24-98398c955a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:26.816947 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b9dd-3872-40d5-8e24-98398c955a85 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:26.821056 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:26.828581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 501/1000] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:05:29.229955 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4d11a-7632-4559-bf21-2df3e02c4e93 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:29.230460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4d11a-7632-4559-bf21-2df3e02c4e93 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:29.230460 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4d11a-7632-4559-bf21-2df3e02c4e93 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:29.231746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 500/1001] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:29.237284 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d434-441d-4ae5-b3f7-5965852956b5 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:29.237731 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d434-441d-4ae5-b3f7-5965852956b5 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:29.237826 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99d434-441d-4ae5-b3f7-5965852956b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:29.260103 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1f99d434-441d-4ae5-b3f7-5965852956b5 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:29.261326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1f99d434-441d-4ae5-b3f7-5965852956b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:29.270513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 502/1002] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:29.645247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4d11a-7632-4559-bf21-2df3e02c4e93 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:29.660026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4d11a-7632-4559-bf21-2df3e02c4e93 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:29.666074 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716a11a-28fc-41e3-bca4-6a242b1adac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:29.666674 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a11a-28fc-41e3-bca4-6a242b1adac1 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:29.667008 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a11a-28fc-41e3-bca4-6a242b1adac1 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:29.667209 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a11a-28fc-41e3-bca4-6a242b1adac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:29.676289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a11a-28fc-41e3-bca4-6a242b1adac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:29.677873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a11a-28fc-41e3-bca4-6a242b1adac1 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:29.687700 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 501/1003] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:32.310433 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2249e-a747-459b-aa54-7db69c27c56c None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:32.311030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2249e-a747-459b-aa54-7db69c27c56c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:32.311250 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2249e-a747-459b-aa54-7db69c27c56c None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:32.313895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 503/1004] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:32.322466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f283f0-1d1c-4485-93a0-744a3066bc3d None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:32.323186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f283f0-1d1c-4485-93a0-744a3066bc3d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:32.323278 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f283f0-1d1c-4485-93a0-744a3066bc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:32.357983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-c6f283f0-1d1c-4485-93a0-744a3066bc3d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:32.359350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-c6f283f0-1d1c-4485-93a0-744a3066bc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:32.368212 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 502/1005] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:32.761401 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2249e-a747-459b-aa54-7db69c27c56c None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:32.784732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2249e-a747-459b-aa54-7db69c27c56c None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:32.791866 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2dae4-2405-48d7-856e-f7ce4aa6b652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:32.792524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2dae4-2405-48d7-856e-f7ce4aa6b652 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:32.792926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2dae4-2405-48d7-856e-f7ce4aa6b652 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:32.793227 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2dae4-2405-48d7-856e-f7ce4aa6b652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:32.804106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2dae4-2405-48d7-856e-f7ce4aa6b652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:32.806448 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2dae4-2405-48d7-856e-f7ce4aa6b652 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:32.822815 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 504/1006] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:35.302254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bb6b-d746-47c4-b2df-53b60850e7c2 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.302848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bb6b-d746-47c4-b2df-53b60850e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.302848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bb6b-d746-47c4-b2df-53b60850e7c2 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.304275 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 503/1007] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:35.315182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2a49-a07a-45a2-9d0a-4d7a05c0e8b3 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.315799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2a49-a07a-45a2-9d0a-4d7a05c0e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.316016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2a49-a07a-45a2-9d0a-4d7a05c0e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.348641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-ac1c2a49-a07a-45a2-9d0a-4d7a05c0e8b3 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:35.349950 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-ac1c2a49-a07a-45a2-9d0a-4d7a05c0e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:35.361790 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 505/1008] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:35.830482 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bb6b-d746-47c4-b2df-53b60850e7c2 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.839324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=37 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:35.848271 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bb6b-d746-47c4-b2df-53b60850e7c2 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.855207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6130db-1b43-4d8a-a970-b7d196575e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.856056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6130db-1b43-4d8a-a970-b7d196575e17 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.856450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6130db-1b43-4d8a-a970-b7d196575e17 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.856738 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6130db-1b43-4d8a-a970-b7d196575e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.870690 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6130db-1b43-4d8a-a970-b7d196575e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.873123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6130db-1b43-4d8a-a970-b7d196575e17 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.886887 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 504/1009] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:05:38.627216 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e62f-7ff9-44a9-ac5e-c1ad568a0213 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.628327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e62f-7ff9-44a9-ac5e-c1ad568a0213 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.628327 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e62f-7ff9-44a9-ac5e-c1ad568a0213 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.630305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 506/1010] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:38.640568 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe274e-c659-4fbf-99e9-12ae1e2bfd65 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.641486 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe274e-c659-4fbf-99e9-12ae1e2bfd65 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.641912 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe274e-c659-4fbf-99e9-12ae1e2bfd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.685989 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-fdfe274e-c659-4fbf-99e9-12ae1e2bfd65 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:38.687485 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-fdfe274e-c659-4fbf-99e9-12ae1e2bfd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:38.699302 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 505/1011] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:39.453255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e62f-7ff9-44a9-ac5e-c1ad568a0213 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:39.478606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e62f-7ff9-44a9-ac5e-c1ad568a0213 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:39.484650 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f6cc-ac5e-49d9-8639-0091d7f1dc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:39.485290 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f6cc-ac5e-49d9-8639-0091d7f1dc06 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.485582 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f6cc-ac5e-49d9-8639-0091d7f1dc06 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.485868 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f6cc-ac5e-49d9-8639-0091d7f1dc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.498882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288f6cc-ac5e-49d9-8639-0091d7f1dc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:39.498882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288f6cc-ac5e-49d9-8639-0091d7f1dc06 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.508762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 507/1012] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:42.492966 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb666-bff3-4ff9-89c1-7e1a667e699e None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:42.493864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb666-bff3-4ff9-89c1-7e1a667e699e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:42.493864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb666-bff3-4ff9-89c1-7e1a667e699e None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:42.495711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 506/1013] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:42.502919 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f482-3ec5-417f-a336-ec3055e3c930 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:42.503485 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f482-3ec5-417f-a336-ec3055e3c930 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:42.503655 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f482-3ec5-417f-a336-ec3055e3c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:42.533945 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1963f482-3ec5-417f-a336-ec3055e3c930 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:42.535182 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1963f482-3ec5-417f-a336-ec3055e3c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:42.544205 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 508/1014] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:42.776840 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83d26-7a83-4488-a957-527451fee68c None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:42.777398 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83d26-7a83-4488-a957-527451fee68c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:42.777838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83d26-7a83-4488-a957-527451fee68c None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:42.779356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 507/1015] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:42.786256 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eecc3-aeaa-4686-996a-dccc1dacf5bb None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:42.786617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eecc3-aeaa-4686-996a-dccc1dacf5bb None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:42.786899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eecc3-aeaa-4686-996a-dccc1dacf5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:42.809513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-da9eecc3-aeaa-4686-996a-dccc1dacf5bb None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:42.810732 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-da9eecc3-aeaa-4686-996a-dccc1dacf5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:42.821020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 509/1016] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:42.904801 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c83d26-7a83-4488-a957-527451fee68c None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:42.920592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c83d26-7a83-4488-a957-527451fee68c None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:42.925987 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b4090-eaca-45da-95d6-cd01fac1afdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:42.926592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b4090-eaca-45da-95d6-cd01fac1afdd service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:42.926872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b4090-eaca-45da-95d6-cd01fac1afdd service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:42.927147 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b4090-eaca-45da-95d6-cd01fac1afdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:42.936904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b4090-eaca-45da-95d6-cd01fac1afdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:42.938579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b4090-eaca-45da-95d6-cd01fac1afdd service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:42.950201 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 508/1017] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:43.201561 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea078f4-2cca-41e4-9cae-f3aae425de31 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:43.202001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea078f4-2cca-41e4-9cae-f3aae425de31 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:43.202444 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea078f4-2cca-41e4-9cae-f3aae425de31 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:43.204136 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 510/1018] 10.222.0.78 () {54 vars in 967 bytes} [Thu Aug 25 03:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:05:43.210026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd67c9-712e-4f5f-a350-23654abebe16 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:43.210473 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd67c9-712e-4f5f-a350-23654abebe16 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:43.210863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd67c9-712e-4f5f-a350-23654abebe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:43.267541 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-dbbd67c9-712e-4f5f-a350-23654abebe16 None None] MFA Rules not processed for user `4ebfffc00f19438a99c15c9e17c24719`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:43.269835 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-dbbd67c9-712e-4f5f-a350-23654abebe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:43.343668 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 509/1019] 10.222.0.78 () {58 vars in 1064 bytes} [Thu Aug 25 03:05:43 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:43.357387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea078f4-2cca-41e4-9cae-f3aae425de31 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:43.372256 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea078f4-2cca-41e4-9cae-f3aae425de31 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:43.377506 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b086-3836-4859-8971-0c9b0733a87a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ebfffc00f19438a99c15c9e17c24719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:43.378434 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b086-3836-4859-8971-0c9b0733a87a service glance] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:43.378851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b086-3836-4859-8971-0c9b0733a87a service glance] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:43.379251 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b086-3836-4859-8971-0c9b0733a87a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:43.390716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b086-3836-4859-8971-0c9b0733a87a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:43.392239 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b086-3836-4859-8971-0c9b0733a87a service glance] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:43.403938 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 511/1020] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:05:45.377712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557521-30e5-41cd-9494-7471f3be4256 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:45.378361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557521-30e5-41cd-9494-7471f3be4256 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:45.378361 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557521-30e5-41cd-9494-7471f3be4256 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:45.379604 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 510/1021] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:45.386122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97764f51-13bd-4abe-82ab-44cb78f6e30b None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:45.386987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97764f51-13bd-4abe-82ab-44cb78f6e30b None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:45.386987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97764f51-13bd-4abe-82ab-44cb78f6e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:45.411378 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-97764f51-13bd-4abe-82ab-44cb78f6e30b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:45.412942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-97764f51-13bd-4abe-82ab-44cb78f6e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:45.422116 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 512/1022] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:45.774882 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557521-30e5-41cd-9494-7471f3be4256 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:45.794310 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557521-30e5-41cd-9494-7471f3be4256 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:45.799520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c09aa-5d1e-46f2-9ddd-475f659e97cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:45.800160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c09aa-5d1e-46f2-9ddd-475f659e97cf service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:45.800438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c09aa-5d1e-46f2-9ddd-475f659e97cf service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:45.800706 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c09aa-5d1e-46f2-9ddd-475f659e97cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:45.817703 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c09aa-5d1e-46f2-9ddd-475f659e97cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:45.819317 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c09aa-5d1e-46f2-9ddd-475f659e97cf service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:45.835971 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 511/1023] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:48.231498 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe2a2-3186-45fc-94ca-409dd9a8912f None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:48.232207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe2a2-3186-45fc-94ca-409dd9a8912f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:48.232207 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe2a2-3186-45fc-94ca-409dd9a8912f None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:48.233457 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 513/1024] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:48.241058 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b677b-6a2a-4fc7-858e-f1b725e07876 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:48.241646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b677b-6a2a-4fc7-858e-f1b725e07876 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:48.241761 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b677b-6a2a-4fc7-858e-f1b725e07876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:48.262342 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-e84b677b-6a2a-4fc7-858e-f1b725e07876 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:48.263566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e84b677b-6a2a-4fc7-858e-f1b725e07876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:48.271701 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 512/1025] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:05:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:48.632018 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabe2a2-3186-45fc-94ca-409dd9a8912f None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:48.646511 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabe2a2-3186-45fc-94ca-409dd9a8912f None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:48.651781 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169456c7-0130-46a3-9063-67528124c0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:48.652426 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169456c7-0130-46a3-9063-67528124c0ca service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:48.652707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169456c7-0130-46a3-9063-67528124c0ca service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:48.652980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169456c7-0130-46a3-9063-67528124c0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:48.662166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169456c7-0130-46a3-9063-67528124c0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:48.664201 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169456c7-0130-46a3-9063-67528124c0ca service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:48.676979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 514/1026] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:58.256352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=56 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:58.672226 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=40 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:58.833964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ebe37-eb2d-4104-9027-cecf3706b901 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:58.834330 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ebe37-eb2d-4104-9027-cecf3706b901 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:58.834605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ebe37-eb2d-4104-9027-cecf3706b901 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:58.836713 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 513/1027] 10.222.0.78 () {54 vars in 918 bytes} [Thu Aug 25 03:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:58.842545 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3260b6-5d38-42a3-821b-7a7e59302807 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:58.842837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3260b6-5d38-42a3-821b-7a7e59302807 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:58.843104 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3260b6-5d38-42a3-821b-7a7e59302807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:58.862149 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-db3260b6-5d38-42a3-821b-7a7e59302807 None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:58.876289 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-db3260b6-5d38-42a3-821b-7a7e59302807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:58.885385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 515/1028] 10.222.0.78 () {58 vars in 1015 bytes} [Thu Aug 25 03:05:58 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:58.899488 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9538f-9b9e-4469-aba8-559f849848db None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:58.899770 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9538f-9b9e-4469-aba8-559f849848db None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:58.900081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9538f-9b9e-4469-aba8-559f849848db None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:58.901359 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 514/1029] 10.222.0.78 () {54 vars in 918 bytes} [Thu Aug 25 03:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:05:58.905888 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7826-cd61-412c-ac2d-66b26dd85f6c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:58.906154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7826-cd61-412c-ac2d-66b26dd85f6c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:58.906430 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7826-cd61-412c-ac2d-66b26dd85f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:58.925285 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8eff7826-cd61-412c-ac2d-66b26dd85f6c None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:58.926400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8eff7826-cd61-412c-ac2d-66b26dd85f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:58.935222 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 516/1030] 10.222.0.78 () {58 vars in 1015 bytes} [Thu Aug 25 03:05:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:01.640897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c369-7542-49bd-8c6e-e4bff6d2fbeb None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:01.641489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c369-7542-49bd-8c6e-e4bff6d2fbeb None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:01.641489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c369-7542-49bd-8c6e-e4bff6d2fbeb None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:01.642717 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:01.648212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096bd59-fc21-460c-b471-9b89cf76e28d None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:01.648841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096bd59-fc21-460c-b471-9b89cf76e28d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:01.648841 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096bd59-fc21-460c-b471-9b89cf76e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:01.668507 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-a096bd59-fc21-460c-b471-9b89cf76e28d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:01.669711 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-a096bd59-fc21-460c-b471-9b89cf76e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:01.677502 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:02.024118 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58c369-7542-49bd-8c6e-e4bff6d2fbeb None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:02.038617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58c369-7542-49bd-8c6e-e4bff6d2fbeb None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:02.044665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f449-f239-4630-ba8b-100b62ac9d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:02.045268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f449-f239-4630-ba8b-100b62ac9d56 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:02.045548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f449-f239-4630-ba8b-100b62ac9d56 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:02.045822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f449-f239-4630-ba8b-100b62ac9d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:02.054077 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64f449-f239-4630-ba8b-100b62ac9d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:02.055688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64f449-f239-4630-ba8b-100b62ac9d56 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:02.065104 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 516/1033] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:03.022225 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a96b-8ce9-4ea0-9359-94d337864a67 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:03.022744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a96b-8ce9-4ea0-9359-94d337864a67 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:03.022744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a96b-8ce9-4ea0-9359-94d337864a67 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:03.024053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:03.028828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6f65-f9a3-4060-825d-7520109b4a55 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:03.029266 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6f65-f9a3-4060-825d-7520109b4a55 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:03.029374 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6f65-f9a3-4060-825d-7520109b4a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:03.048651 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-2d1c6f65-f9a3-4060-825d-7520109b4a55 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:03.049844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-2d1c6f65-f9a3-4060-825d-7520109b4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:03.058140 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:03.261766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a96b-8ce9-4ea0-9359-94d337864a67 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:03.277819 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a96b-8ce9-4ea0-9359-94d337864a67 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:03.284335 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a489-7106-4739-919a-4a2a7845e691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:03.284935 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a489-7106-4739-919a-4a2a7845e691 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:03.285215 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a489-7106-4739-919a-4a2a7845e691 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:03.285484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a489-7106-4739-919a-4a2a7845e691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:03.294833 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a489-7106-4739-919a-4a2a7845e691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:03.296499 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a489-7106-4739-919a-4a2a7845e691 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:03.306299 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 519/1036] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:04.226509 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87d0a6-4ed3-4ea0-a4f7-0d3c4caaa0a3 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:04.227082 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87d0a6-4ed3-4ea0-a4f7-0d3c4caaa0a3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:04.227082 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87d0a6-4ed3-4ea0-a4f7-0d3c4caaa0a3 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:04.228473 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:04.233281 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c1b8f-b9d3-470b-95cd-c1178a1a2ed7 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:04.233722 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c1b8f-b9d3-470b-95cd-c1178a1a2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:04.233820 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c1b8f-b9d3-470b-95cd-c1178a1a2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:04.254875 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-a17c1b8f-b9d3-470b-95cd-c1178a1a2ed7 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:04.256095 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-a17c1b8f-b9d3-470b-95cd-c1178a1a2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:04.264438 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:04.419152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87d0a6-4ed3-4ea0-a4f7-0d3c4caaa0a3 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:04.433169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87d0a6-4ed3-4ea0-a4f7-0d3c4caaa0a3 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:04.437957 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320ecc1-1708-4b65-bee2-4b6972d763a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:04.438543 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320ecc1-1708-4b65-bee2-4b6972d763a8 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:04.438818 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320ecc1-1708-4b65-bee2-4b6972d763a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:04.439093 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320ecc1-1708-4b65-bee2-4b6972d763a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:04.447608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320ecc1-1708-4b65-bee2-4b6972d763a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:04.449327 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320ecc1-1708-4b65-bee2-4b6972d763a8 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:04.458466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 519/1039] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:05.365631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd68f-7c29-4389-8df0-b3657d2b629e None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:05.366176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd68f-7c29-4389-8df0-b3657d2b629e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:05.366176 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd68f-7c29-4389-8df0-b3657d2b629e None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:05.367625 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:05.373555 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e2372-740a-40a6-b7b5-c35d99f47837 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:05.374045 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e2372-740a-40a6-b7b5-c35d99f47837 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:05.374161 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e2372-740a-40a6-b7b5-c35d99f47837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:05.394272 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-889e2372-740a-40a6-b7b5-c35d99f47837 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:05.395518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-889e2372-740a-40a6-b7b5-c35d99f47837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:05.404091 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:05.562769 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbd68f-7c29-4389-8df0-b3657d2b629e None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:05.576976 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbd68f-7c29-4389-8df0-b3657d2b629e None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:05.581818 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5fd7b-6146-4425-83b0-6bb0a358d6c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:05.582406 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5fd7b-6146-4425-83b0-6bb0a358d6c6 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:05.582686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5fd7b-6146-4425-83b0-6bb0a358d6c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:05.582957 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5fd7b-6146-4425-83b0-6bb0a358d6c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:05.591744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5fd7b-6146-4425-83b0-6bb0a358d6c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:05.593366 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5fd7b-6146-4425-83b0-6bb0a358d6c6 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:05.603186 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 522/1042] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:06.493319 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb9a71-5c77-4483-a2d5-a320380ce997 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:06.493896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb9a71-5c77-4483-a2d5-a320380ce997 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:06.493896 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb9a71-5c77-4483-a2d5-a320380ce997 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:06.495186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:06.500699 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a2a4-b603-4acf-ac9c-ebee48418d76 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:06.501373 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a2a4-b603-4acf-ac9c-ebee48418d76 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:06.501373 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27a2a4-b603-4acf-ac9c-ebee48418d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:06.521015 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-fb27a2a4-b603-4acf-ac9c-ebee48418d76 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:06.522218 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-fb27a2a4-b603-4acf-ac9c-ebee48418d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:06.531098 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:06.691925 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb9a71-5c77-4483-a2d5-a320380ce997 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:06.712611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb9a71-5c77-4483-a2d5-a320380ce997 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:06.719783 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ee0e1-0f57-4123-8493-533a3fcc5b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:06.720735 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee0e1-0f57-4123-8493-533a3fcc5b6d service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:06.721168 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee0e1-0f57-4123-8493-533a3fcc5b6d service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:06.721585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee0e1-0f57-4123-8493-533a3fcc5b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:06.734538 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ee0e1-0f57-4123-8493-533a3fcc5b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:06.737139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ee0e1-0f57-4123-8493-533a3fcc5b6d service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:06.750688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 522/1045] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:07.599672 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22aa4c-a226-441e-bd44-816b6d4dcfc6 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:07.600365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22aa4c-a226-441e-bd44-816b6d4dcfc6 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:07.600365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22aa4c-a226-441e-bd44-816b6d4dcfc6 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:07.601489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:07.607346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243fdf-9084-426f-a5cd-8541acb1e95a None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:07.608167 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243fdf-9084-426f-a5cd-8541acb1e95a None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:07.608167 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243fdf-9084-426f-a5cd-8541acb1e95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:07.629255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5a243fdf-9084-426f-a5cd-8541acb1e95a None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:07.630466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5a243fdf-9084-426f-a5cd-8541acb1e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:07.638375 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:07.793736 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22aa4c-a226-441e-bd44-816b6d4dcfc6 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:07.808359 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22aa4c-a226-441e-bd44-816b6d4dcfc6 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:07.813600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57da02f-fb00-4d83-b482-0b823499f5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:07.814198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da02f-fb00-4d83-b482-0b823499f5fb service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:07.814481 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da02f-fb00-4d83-b482-0b823499f5fb service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:07.814762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da02f-fb00-4d83-b482-0b823499f5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:07.824161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57da02f-fb00-4d83-b482-0b823499f5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:07.825784 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57da02f-fb00-4d83-b482-0b823499f5fb service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:07.836293 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 525/1048] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:08.658422 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d977b-db9c-451c-8c83-d78abd14e8d1 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:08.659025 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d977b-db9c-451c-8c83-d78abd14e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:08.659239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d977b-db9c-451c-8c83-d78abd14e8d1 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:08.661120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:08.667053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de605c5a-9656-4125-9d84-c664e2950014 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:08.667534 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de605c5a-9656-4125-9d84-c664e2950014 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:08.667652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de605c5a-9656-4125-9d84-c664e2950014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:08.691845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-de605c5a-9656-4125-9d84-c664e2950014 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:08.693318 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-de605c5a-9656-4125-9d84-c664e2950014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:08.705505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:08.872820 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d977b-db9c-451c-8c83-d78abd14e8d1 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:08.888711 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d977b-db9c-451c-8c83-d78abd14e8d1 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:08.898210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c02e-263d-4efb-9d77-369a17e79147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:08.898816 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c02e-263d-4efb-9d77-369a17e79147 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:08.899090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c02e-263d-4efb-9d77-369a17e79147 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:08.899373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c02e-263d-4efb-9d77-369a17e79147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:08.908292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3c02e-263d-4efb-9d77-369a17e79147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:08.909958 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3c02e-263d-4efb-9d77-369a17e79147 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:08.920011 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 525/1051] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:09.783255 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc63c-66ba-444f-9d76-5722da563c57 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:09.784165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc63c-66ba-444f-9d76-5722da563c57 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:09.784165 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc63c-66ba-444f-9d76-5722da563c57 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:09.785446 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:06:09.792248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9731062-8f03-4cee-b096-b45edd6f1d13 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:09.793056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9731062-8f03-4cee-b096-b45edd6f1d13 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:09.793256 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9731062-8f03-4cee-b096-b45edd6f1d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:09.816540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b9731062-8f03-4cee-b096-b45edd6f1d13 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:09.817911 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b9731062-8f03-4cee-b096-b45edd6f1d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:09.827698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:09.990643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc63c-66ba-444f-9d76-5722da563c57 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:10.008340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc63c-66ba-444f-9d76-5722da563c57 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:10.014283 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33eaa8-a9bc-4de7-bbb8-ab54fcba2d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:10.014907 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33eaa8-a9bc-4de7-bbb8-ab54fcba2d42 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:10.015187 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33eaa8-a9bc-4de7-bbb8-ab54fcba2d42 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:10.015456 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33eaa8-a9bc-4de7-bbb8-ab54fcba2d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:10.027774 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33eaa8-a9bc-4de7-bbb8-ab54fcba2d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:10.029932 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33eaa8-a9bc-4de7-bbb8-ab54fcba2d42 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:10.041132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 528/1054] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:10.928114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e13f-3967-4093-99da-8e9114c251a9 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:10.928695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e13f-3967-4093-99da-8e9114c251a9 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:10.928695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e13f-3967-4093-99da-8e9114c251a9 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:10.930160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:10.935907 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580d46-9bf2-4841-bf7a-3755617f6e07 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:10.936412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580d46-9bf2-4841-bf7a-3755617f6e07 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:10.936412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580d46-9bf2-4841-bf7a-3755617f6e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:10.958984 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-be580d46-9bf2-4841-bf7a-3755617f6e07 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:10.960497 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-be580d46-9bf2-4841-bf7a-3755617f6e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:10.972630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:06:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:11.132476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e13f-3967-4093-99da-8e9114c251a9 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:11.146328 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e13f-3967-4093-99da-8e9114c251a9 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:11.151924 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2983-3394-4cf0-a1be-b28180a09218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:11.152592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2983-3394-4cf0-a1be-b28180a09218 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.152867 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2983-3394-4cf0-a1be-b28180a09218 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.153135 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2983-3394-4cf0-a1be-b28180a09218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:11.163731 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf2983-3394-4cf0-a1be-b28180a09218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:11.166107 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf2983-3394-4cf0-a1be-b28180a09218 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:11.177347 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 528/1057] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:13.325871 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f090f-4448-4942-b99d-428d9d3413fa None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:13.326643 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f090f-4448-4942-b99d-428d9d3413fa None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:13.326822 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f090f-4448-4942-b99d-428d9d3413fa None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:13.328360 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:13.334162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9c0d1-f496-46fa-b7d7-9f3aaf8b1d47 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:13.334651 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9c0d1-f496-46fa-b7d7-9f3aaf8b1d47 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:13.334789 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9c0d1-f496-46fa-b7d7-9f3aaf8b1d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:13.355321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-52a9c0d1-f496-46fa-b7d7-9f3aaf8b1d47 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:13.356556 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-52a9c0d1-f496-46fa-b7d7-9f3aaf8b1d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:13.364458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:13.712308 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f090f-4448-4942-b99d-428d9d3413fa None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:13.726772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f090f-4448-4942-b99d-428d9d3413fa None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:13.730847 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61bc7-f0f5-4b20-a69d-b55247c65080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:13.731584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61bc7-f0f5-4b20-a69d-b55247c65080 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:13.732030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61bc7-f0f5-4b20-a69d-b55247c65080 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:13.732396 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61bc7-f0f5-4b20-a69d-b55247c65080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:13.747156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61bc7-f0f5-4b20-a69d-b55247c65080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:13.748890 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61bc7-f0f5-4b20-a69d-b55247c65080 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:13.759580 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 531/1060] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:16.181466 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415590b-a521-45d1-8895-678671877dc3 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:16.182004 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415590b-a521-45d1-8895-678671877dc3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:16.182004 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415590b-a521-45d1-8895-678671877dc3 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:16.183483 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:16.189622 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a6339-51b3-4326-91ae-6fd6753c965f None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:16.190300 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a6339-51b3-4326-91ae-6fd6753c965f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:16.190300 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a6339-51b3-4326-91ae-6fd6753c965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:16.211128 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-cb1a6339-51b3-4326-91ae-6fd6753c965f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:16.212885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-cb1a6339-51b3-4326-91ae-6fd6753c965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:16.221392 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:16.575985 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415590b-a521-45d1-8895-678671877dc3 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:16.590650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415590b-a521-45d1-8895-678671877dc3 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:16.601294 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940304a-4518-4ac2-91d6-23199d7c091d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:16.601906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940304a-4518-4ac2-91d6-23199d7c091d service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:16.602226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940304a-4518-4ac2-91d6-23199d7c091d service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:16.602490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940304a-4518-4ac2-91d6-23199d7c091d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:16.614207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940304a-4518-4ac2-91d6-23199d7c091d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:16.615663 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940304a-4518-4ac2-91d6-23199d7c091d service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:16.626682 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 531/1063] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:19.380071 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63498d-be28-46d6-b28a-c741f7277967 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.380652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63498d-be28-46d6-b28a-c741f7277967 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.380652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63498d-be28-46d6-b28a-c741f7277967 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.381973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:19.389352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91baca9-963b-49f1-8c2c-cdd4a0eee265 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.389912 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91baca9-963b-49f1-8c2c-cdd4a0eee265 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.390194 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91baca9-963b-49f1-8c2c-cdd4a0eee265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.414329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a91baca9-963b-49f1-8c2c-cdd4a0eee265 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:19.416073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a91baca9-963b-49f1-8c2c-cdd4a0eee265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.428920 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:19.785929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63498d-be28-46d6-b28a-c741f7277967 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:19.806237 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63498d-be28-46d6-b28a-c741f7277967 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:19.811885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca20e8-35da-4440-b48d-2208df59f417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:19.812857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca20e8-35da-4440-b48d-2208df59f417 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.813338 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca20e8-35da-4440-b48d-2208df59f417 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.813806 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca20e8-35da-4440-b48d-2208df59f417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.828942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca20e8-35da-4440-b48d-2208df59f417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:19.830867 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca20e8-35da-4440-b48d-2208df59f417 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:19.847213 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 534/1066] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:22.251137 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227c8d8-8810-4450-a97a-730b9116dde4 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:22.251746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227c8d8-8810-4450-a97a-730b9116dde4 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:22.251746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227c8d8-8810-4450-a97a-730b9116dde4 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:22.253318 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:22.259372 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3e3d-4147-4b52-9cc0-49306b8ca21d None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:22.259920 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3e3d-4147-4b52-9cc0-49306b8ca21d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:22.260042 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3e3d-4147-4b52-9cc0-49306b8ca21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:22.292790 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-438b3e3d-4147-4b52-9cc0-49306b8ca21d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:22.294656 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-438b3e3d-4147-4b52-9cc0-49306b8ca21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:22.303184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:22.654248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227c8d8-8810-4450-a97a-730b9116dde4 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:22.665386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227c8d8-8810-4450-a97a-730b9116dde4 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:22.668964 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cdc2-855d-4b81-acf9-f70e0fe062d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:22.669567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cdc2-855d-4b81-acf9-f70e0fe062d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:22.669844 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cdc2-855d-4b81-acf9-f70e0fe062d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:22.670110 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cdc2-855d-4b81-acf9-f70e0fe062d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:22.686245 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7cdc2-855d-4b81-acf9-f70e0fe062d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:22.687718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7cdc2-855d-4b81-acf9-f70e0fe062d8 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:22.699020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 534/1069] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:25.444941 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3bc3c-c739-440b-9ca3-03774bfb0b41 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.445528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3bc3c-c739-440b-9ca3-03774bfb0b41 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.445528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3bc3c-c739-440b-9ca3-03774bfb0b41 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.446883 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:06:25.452600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774ede9-cd1a-4926-9e60-bedf9c5772a6 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.453116 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774ede9-cd1a-4926-9e60-bedf9c5772a6 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.453246 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774ede9-cd1a-4926-9e60-bedf9c5772a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.473181 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-e774ede9-cd1a-4926-9e60-bedf9c5772a6 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:25.474573 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e774ede9-cd1a-4926-9e60-bedf9c5772a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:25.485871 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:25.848760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3bc3c-c739-440b-9ca3-03774bfb0b41 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.866209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3bc3c-c739-440b-9ca3-03774bfb0b41 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.872884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff7408-51b4-4196-a522-186976677bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.874174 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7408-51b4-4196-a522-186976677bef service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.874652 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7408-51b4-4196-a522-186976677bef service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.875122 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7408-51b4-4196-a522-186976677bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.892025 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff7408-51b4-4196-a522-186976677bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.894715 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff7408-51b4-4196-a522-186976677bef service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.912904 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 537/1072] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:28.430586 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f09a41-b2f1-493b-8bd9-7c67e532f22c None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:28.431239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f09a41-b2f1-493b-8bd9-7c67e532f22c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:28.431520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f09a41-b2f1-493b-8bd9-7c67e532f22c None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:28.433721 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:28.442683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa92c-4e43-4177-8001-3406ddf73cee None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:28.443246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa92c-4e43-4177-8001-3406ddf73cee None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:28.443609 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa92c-4e43-4177-8001-3406ddf73cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:28.480227 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-77caa92c-4e43-4177-8001-3406ddf73cee None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:28.482879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-77caa92c-4e43-4177-8001-3406ddf73cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:28.501326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:28.913966 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f09a41-b2f1-493b-8bd9-7c67e532f22c None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:28.923207 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=64 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:28.933827 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f09a41-b2f1-493b-8bd9-7c67e532f22c None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:28.937715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1a68a-52bd-4137-837e-8ccfabb12007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:28.938334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a68a-52bd-4137-837e-8ccfabb12007 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:28.938610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a68a-52bd-4137-837e-8ccfabb12007 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:28.938879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a68a-52bd-4137-837e-8ccfabb12007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:28.950173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1a68a-52bd-4137-837e-8ccfabb12007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:28.951709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1a68a-52bd-4137-837e-8ccfabb12007 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:28.963117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 537/1075] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:31.387584 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0865631-2cc2-46fd-97ff-ff72b86a3a36 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.388221 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0865631-2cc2-46fd-97ff-ff72b86a3a36 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.388557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0865631-2cc2-46fd-97ff-ff72b86a3a36 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.390902 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:31.401371 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115246-8d00-4b91-a576-eb1fd5c4f65d None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.401934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115246-8d00-4b91-a576-eb1fd5c4f65d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.402319 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115246-8d00-4b91-a576-eb1fd5c4f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.426592 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-96115246-8d00-4b91-a576-eb1fd5c4f65d None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:31.427963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-96115246-8d00-4b91-a576-eb1fd5c4f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:31.436849 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:31.972302 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0865631-2cc2-46fd-97ff-ff72b86a3a36 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:31.979172 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=73 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:31.987200 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0865631-2cc2-46fd-97ff-ff72b86a3a36 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:31.991046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de789-cfb4-4829-87fa-3eb018f315e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:31.991694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de789-cfb4-4829-87fa-3eb018f315e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.992143 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de789-cfb4-4829-87fa-3eb018f315e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.992525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de789-cfb4-4829-87fa-3eb018f315e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:32.003471 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de789-cfb4-4829-87fa-3eb018f315e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:32.005062 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de789-cfb4-4829-87fa-3eb018f315e1 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:32.016282 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 540/1078] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:34.546542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29a412-2d59-40e2-aa9a-9941f36c1777 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:34.547329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29a412-2d59-40e2-aa9a-9941f36c1777 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:34.547329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29a412-2d59-40e2-aa9a-9941f36c1777 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:34.548496 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:06:34.555718 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923a7b-4219-4042-b47a-d7e07390c7ba None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:34.556484 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923a7b-4219-4042-b47a-d7e07390c7ba None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:34.556690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923a7b-4219-4042-b47a-d7e07390c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:34.590527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-bd923a7b-4219-4042-b47a-d7e07390c7ba None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:34.592488 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-bd923a7b-4219-4042-b47a-d7e07390c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:34.605843 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:34.970070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29a412-2d59-40e2-aa9a-9941f36c1777 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:34.989966 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29a412-2d59-40e2-aa9a-9941f36c1777 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:34.994247 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8385b-470c-4e46-99ef-40e5ea90ee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:34.994887 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8385b-470c-4e46-99ef-40e5ea90ee24 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:34.995164 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8385b-470c-4e46-99ef-40e5ea90ee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:34.995442 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8385b-470c-4e46-99ef-40e5ea90ee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:35.006610 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8385b-470c-4e46-99ef-40e5ea90ee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:35.008381 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8385b-470c-4e46-99ef-40e5ea90ee24 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:35.019545 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 540/1081] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:37.468991 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceba15d-74b2-4fc6-af99-568300e9c45d None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:37.469592 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceba15d-74b2-4fc6-af99-568300e9c45d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:37.469926 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceba15d-74b2-4fc6-af99-568300e9c45d None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:37.472468 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:06:37.479241 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88855f3-10ef-4bcc-8b88-6be04e3e04a0 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:37.481021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88855f3-10ef-4bcc-8b88-6be04e3e04a0 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:37.481021 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88855f3-10ef-4bcc-8b88-6be04e3e04a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:37.504593 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b88855f3-10ef-4bcc-8b88-6be04e3e04a0 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:37.505821 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b88855f3-10ef-4bcc-8b88-6be04e3e04a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:37.518162 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:37.867803 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceba15d-74b2-4fc6-af99-568300e9c45d None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:37.880695 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceba15d-74b2-4fc6-af99-568300e9c45d None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:37.886234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d63df-1c03-4abe-a8f0-da44fdefbcf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:37.887260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d63df-1c03-4abe-a8f0-da44fdefbcf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:37.887761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d63df-1c03-4abe-a8f0-da44fdefbcf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:37.888277 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d63df-1c03-4abe-a8f0-da44fdefbcf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:37.903043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d63df-1c03-4abe-a8f0-da44fdefbcf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:37.904768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d63df-1c03-4abe-a8f0-da44fdefbcf6 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:37.915870 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 543/1084] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:40.467001 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb811-201e-49d4-a1e9-505f25f07c44 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.467886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb811-201e-49d4-a1e9-505f25f07c44 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.467886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb811-201e-49d4-a1e9-505f25f07c44 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.468901 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:06:40.474510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b21b9-8bd0-4389-8b6f-d5a875e4db04 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.474968 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b21b9-8bd0-4389-8b6f-d5a875e4db04 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.475081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b21b9-8bd0-4389-8b6f-d5a875e4db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.495696 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-e90b21b9-8bd0-4389-8b6f-d5a875e4db04 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:40.496938 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-e90b21b9-8bd0-4389-8b6f-d5a875e4db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:40.505216 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:40.887174 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb811-201e-49d4-a1e9-505f25f07c44 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.904982 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb811-201e-49d4-a1e9-505f25f07c44 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.910812 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480676-0d74-4fe1-9ba0-2ee4a9ea0a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.911795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480676-0d74-4fe1-9ba0-2ee4a9ea0a1c service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.912235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480676-0d74-4fe1-9ba0-2ee4a9ea0a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.912686 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480676-0d74-4fe1-9ba0-2ee4a9ea0a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.925336 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d480676-0d74-4fe1-9ba0-2ee4a9ea0a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.926883 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d480676-0d74-4fe1-9ba0-2ee4a9ea0a1c service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.936972 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 543/1087] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:50.489916 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=17 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:50.932600 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=23 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:07.023930 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259119-c3f2-4491-92e3-3797c17ed889 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:07.024495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259119-c3f2-4491-92e3-3797c17ed889 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:07.024495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259119-c3f2-4491-92e3-3797c17ed889 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:07.026453 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 545/1088] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:07:07.031864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4897c-c5d4-40e2-b301-075bf57d6150 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:07.032378 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4897c-c5d4-40e2-b301-075bf57d6150 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:07.032504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4897c-c5d4-40e2-b301-075bf57d6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:07.052464 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-d7d4897c-c5d4-40e2-b301-075bf57d6150 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:07.053699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-d7d4897c-c5d4-40e2-b301-075bf57d6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:07.062341 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 544/1089] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:07.425903 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d21f-551d-4d86-9499-14ce2471c250 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:07.426259 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d21f-551d-4d86-9499-14ce2471c250 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:07.426633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d21f-551d-4d86-9499-14ce2471c250 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:07.428199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 546/1090] 10.222.0.78 () {54 vars in 967 bytes} [Thu Aug 25 03:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:07:07.433931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6d3b-01db-4f75-9edb-ac2e51185948 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:07.434266 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6d3b-01db-4f75-9edb-ac2e51185948 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:07.434587 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6d3b-01db-4f75-9edb-ac2e51185948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:07.454409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-0cae6d3b-01db-4f75-9edb-ac2e51185948 None None] MFA Rules not processed for user `4ebfffc00f19438a99c15c9e17c24719`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:07.455622 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-0cae6d3b-01db-4f75-9edb-ac2e51185948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:07.462725 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 545/1091] 10.222.0.78 () {58 vars in 1064 bytes} [Thu Aug 25 03:07:07 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:07.470153 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d21f-551d-4d86-9499-14ce2471c250 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:07.481719 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d21f-551d-4d86-9499-14ce2471c250 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:07.485275 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b96f-044a-416f-a560-37e4321ee247 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ebfffc00f19438a99c15c9e17c24719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:07.485862 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b96f-044a-416f-a560-37e4321ee247 service glance] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:07.486142 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b96f-044a-416f-a560-37e4321ee247 service glance] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:07.486414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b96f-044a-416f-a560-37e4321ee247 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:07.496232 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b96f-044a-416f-a560-37e4321ee247 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:07.497746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b96f-044a-416f-a560-37e4321ee247 service glance] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:07.508470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 547/1092] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:09.907241 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5f798-b76d-4840-96ea-948ea56e43db None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:09.907873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5f798-b76d-4840-96ea-948ea56e43db None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:09.907873 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5f798-b76d-4840-96ea-948ea56e43db None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:09.909152 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 546/1093] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:07:09.915974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ad7da-4d74-46c5-9343-724a14b25e41 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:09.916591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ad7da-4d74-46c5-9343-724a14b25e41 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:09.916591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ad7da-4d74-46c5-9343-724a14b25e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:09.936988 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-e76ad7da-4d74-46c5-9343-724a14b25e41 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:09.938339 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-e76ad7da-4d74-46c5-9343-724a14b25e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:09.947887 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 548/1094] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:10.282564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5f798-b76d-4840-96ea-948ea56e43db None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:10.302029 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5f798-b76d-4840-96ea-948ea56e43db None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:10.307927 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:10.308767 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:10.309196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:10.309561 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:10.310289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:10.313296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:07:10.313296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:07:10.313296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:07:10.315490 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109d9c-2470-40e1-8fb9-9048f369ebfd admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:10.342000 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 547/1095] 10.222.0.78 () {56 vars in 1108 bytes} [Thu Aug 25 03:07:10 2022] GET /identity/v3/projects => generated 1606 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:12.694294 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a3cc-2247-4b4c-bcd0-981bb0b96807 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.694873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a3cc-2247-4b4c-bcd0-981bb0b96807 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.694873 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a3cc-2247-4b4c-bcd0-981bb0b96807 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.696853 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 549/1096] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:07:12.707087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ac88-755f-443e-982e-89750f983001 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.707656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ac88-755f-443e-982e-89750f983001 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.707656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ac88-755f-443e-982e-89750f983001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.729585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-eca5ac88-755f-443e-982e-89750f983001 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:12.730879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-eca5ac88-755f-443e-982e-89750f983001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:12.739786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 548/1097] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:13.138329 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a3cc-2247-4b4c-bcd0-981bb0b96807 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:13.154066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a3cc-2247-4b4c-bcd0-981bb0b96807 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:13.159846 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862c74e-1b0d-40b7-888e-4154ea6f396b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:13.160486 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c74e-1b0d-40b7-888e-4154ea6f396b service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:13.160759 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c74e-1b0d-40b7-888e-4154ea6f396b service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:13.161029 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862c74e-1b0d-40b7-888e-4154ea6f396b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:13.171927 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862c74e-1b0d-40b7-888e-4154ea6f396b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:13.173618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862c74e-1b0d-40b7-888e-4154ea6f396b service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:13.187716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 550/1098] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:15.730124 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95e686-90e5-48d2-a5ca-700aeb754fe9 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:15.730951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95e686-90e5-48d2-a5ca-700aeb754fe9 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:15.731136 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95e686-90e5-48d2-a5ca-700aeb754fe9 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:15.733157 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 549/1099] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:07:15.741027 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c183b-7fe7-41a2-bf01-31eb397b9349 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:15.741550 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c183b-7fe7-41a2-bf01-31eb397b9349 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:15.741653 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c183b-7fe7-41a2-bf01-31eb397b9349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:15.762047 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-af2c183b-7fe7-41a2-bf01-31eb397b9349 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:15.763272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-af2c183b-7fe7-41a2-bf01-31eb397b9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:15.772300 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 551/1100] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:16.123392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95e686-90e5-48d2-a5ca-700aeb754fe9 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:16.135975 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95e686-90e5-48d2-a5ca-700aeb754fe9 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:16.139665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e7b0a-40b9-4329-80f1-b8dc2cf722ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:16.141542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e7b0a-40b9-4329-80f1-b8dc2cf722ca service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:16.141542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e7b0a-40b9-4329-80f1-b8dc2cf722ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:16.141542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e7b0a-40b9-4329-80f1-b8dc2cf722ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:16.155750 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e7b0a-40b9-4329-80f1-b8dc2cf722ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:16.157114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e7b0a-40b9-4329-80f1-b8dc2cf722ca service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:16.169692 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 550/1101] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:18.560138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d70875-3df1-4b31-8157-1f1626e96cac None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.560674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d70875-3df1-4b31-8157-1f1626e96cac None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.560674 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d70875-3df1-4b31-8157-1f1626e96cac None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.562010 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 552/1102] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:07:18.567510 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d342-ff2f-4f2b-8a69-878d29e3b284 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.568153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d342-ff2f-4f2b-8a69-878d29e3b284 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.568153 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d342-ff2f-4f2b-8a69-878d29e3b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.588760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-86e8d342-ff2f-4f2b-8a69-878d29e3b284 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:18.589897 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-86e8d342-ff2f-4f2b-8a69-878d29e3b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:18.597922 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 551/1103] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:18.953922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d70875-3df1-4b31-8157-1f1626e96cac None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:18.965683 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d70875-3df1-4b31-8157-1f1626e96cac None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:18.970194 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b72d06-f805-479d-9443-7ceafe40a7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:18.970898 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b72d06-f805-479d-9443-7ceafe40a7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.971280 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b72d06-f805-479d-9443-7ceafe40a7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.971677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b72d06-f805-479d-9443-7ceafe40a7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.982274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b72d06-f805-479d-9443-7ceafe40a7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:18.983738 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b72d06-f805-479d-9443-7ceafe40a7c5 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:18.995161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 553/1104] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:21.457353 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a31be-d17c-4db1-8d06-f2337707103d None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:21.458048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a31be-d17c-4db1-8d06-f2337707103d None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:21.458048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a31be-d17c-4db1-8d06-f2337707103d None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:21.459210 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 552/1105] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:07:21.465849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437f816-e4c7-47d9-b03e-c3366046c299 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:21.466344 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437f816-e4c7-47d9-b03e-c3366046c299 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:21.466458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437f816-e4c7-47d9-b03e-c3366046c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:21.486180 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-9437f816-e4c7-47d9-b03e-c3366046c299 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:21.487393 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-9437f816-e4c7-47d9-b03e-c3366046c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:21.496451 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 554/1106] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:21.849290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a31be-d17c-4db1-8d06-f2337707103d None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:21.862768 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a31be-d17c-4db1-8d06-f2337707103d None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:21.867226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aca64b-3cc7-4379-9386-55d7a6cc32a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:21.867890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aca64b-3cc7-4379-9386-55d7a6cc32a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:21.868197 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aca64b-3cc7-4379-9386-55d7a6cc32a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:21.868479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aca64b-3cc7-4379-9386-55d7a6cc32a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:21.878736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aca64b-3cc7-4379-9386-55d7a6cc32a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:21.880230 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aca64b-3cc7-4379-9386-55d7a6cc32a1 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:21.890444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 553/1107] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:24.393471 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d17e7-e2cb-4783-9c1c-7202bfec336f None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:24.394038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d17e7-e2cb-4783-9c1c-7202bfec336f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:24.394038 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d17e7-e2cb-4783-9c1c-7202bfec336f None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:24.395350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 555/1108] 10.222.0.78 () {54 vars in 927 bytes} [Thu Aug 25 03:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:07:24.401024 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f4a2f-dabd-4864-a37d-b99aa1f81875 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:24.401549 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f4a2f-dabd-4864-a37d-b99aa1f81875 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:24.401670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f4a2f-dabd-4864-a37d-b99aa1f81875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:24.420904 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-1e5f4a2f-dabd-4864-a37d-b99aa1f81875 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:24.422099 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-1e5f4a2f-dabd-4864-a37d-b99aa1f81875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:24.430416 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 554/1109] 10.222.0.78 () {58 vars in 1024 bytes} [Thu Aug 25 03:07:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:24.773482 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d17e7-e2cb-4783-9c1c-7202bfec336f None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:24.784089 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d17e7-e2cb-4783-9c1c-7202bfec336f None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:24.787521 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9a2b4-91b7-4700-81d9-9ea778ae5ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:24.788264 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9a2b4-91b7-4700-81d9-9ea778ae5ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:24.789973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9a2b4-91b7-4700-81d9-9ea778ae5ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:24.790458 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9a2b4-91b7-4700-81d9-9ea778ae5ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:24.801145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9a2b4-91b7-4700-81d9-9ea778ae5ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:24.802587 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9a2b4-91b7-4700-81d9-9ea778ae5ff8 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:24.812645 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 556/1110] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:34.416143 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=33 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:34.808473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=33 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:40.212813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.213463 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.213760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.243176 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:40.244454 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:40.252695 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 555/1111] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:08:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:08:40.261630 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.262198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.262198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.281913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:40.283106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:40.291856 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 557/1112] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:08:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:40.296584 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.307059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd145d-bd00-4839-bba9-ae431ccb5e28 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.311628 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.312268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.312548 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.312822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.313469 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:08:40.313770 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.314778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:40.314778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:08:40.314778 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:08:40.315662 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.330616 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 556/1113] 10.222.0.78 () {58 vars in 1153 bytes} [Thu Aug 25 03:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:08:40.338851 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.350024 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03025945-cd6d-49f1-84e3-d27432054dc4 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.354729 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.355328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.355606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.355908 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.356573 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.358385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:40.358385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:08:40.358385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:08:40.359588 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.389581 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 558/1114] 10.222.0.78 () {60 vars in 1153 bytes} [Thu Aug 25 03:08:40 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:08:40.393941 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.404291 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54aee-8f6a-418b-a5ba-385606fa943a admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.462455 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.463113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.463343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.463643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.464307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.465324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:40.465324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:08:40.465324 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:08:40.466580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.492191 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 557/1115] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:08:40 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:08:40.496389 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.506942 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a25319-8c20-4901-8c81-5b6235853095 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.513308 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.514673 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.515487 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.516326 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.517786 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.519894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:40.519894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:08:40.519894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:08:40.520825 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.533918 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 559/1116] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:08:40.538963 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.550116 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c2b9-f997-4dbe-8e78-2437c7b864e1 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.555462 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.556097 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.556379 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.556649 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.557282 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.558289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:40.558289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:08:40.558289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:08:40.559173 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc8b8f-d37b-4236-9339-e253f2391666 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.572268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 558/1117] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:08:40.576518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.586640 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c482084-cced-43a0-81f7-0a01541b4108 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.591332 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.592026 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.592330 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.592611 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] PATH_INFO: `/v3/projects/be451bda3f5f4805b569a06b3c826e5e/users/973f8d5c1d104eedbabf74f4b155e4ec/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.608531 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be451bda3f5f4805b569a06b3c826e5e, user_id=973f8d5c1d104eedbabf74f4b155e4ec, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.609612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:40.609612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:08:40.609612 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:08:40.611704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79d735-7352-45fb-acff-fb4319adb3a7 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.627987 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 560/1118] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:08:40 2022] PUT /identity/v3/projects/be451bda3f5f4805b569a06b3c826e5e/users/973f8d5c1d104eedbabf74f4b155e4ec/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:40.640102 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5221e-d220-4404-af91-dececec78229 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.640385 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5221e-d220-4404-af91-dececec78229 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.640665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5221e-d220-4404-af91-dececec78229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.670932 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b4f5221e-d220-4404-af91-dececec78229 None None] MFA Rules not processed for user `973f8d5c1d104eedbabf74f4b155e4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:40.672186 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b4f5221e-d220-4404-af91-dececec78229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:40.734978 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 559/1119] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:08:40 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:40.748666 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ac6d-8c66-40c9-b5e8-a411ca8a98d0 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.748954 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ac6d-8c66-40c9-b5e8-a411ca8a98d0 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.749238 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8ac6d-8c66-40c9-b5e8-a411ca8a98d0 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.750809 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 561/1120] 10.222.0.78 () {54 vars in 964 bytes} [Thu Aug 25 03:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:08:40.756005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c2ff5-f848-4fe1-9e6c-db6f0b12d20e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.756296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c2ff5-f848-4fe1-9e6c-db6f0b12d20e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.756577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c2ff5-f848-4fe1-9e6c-db6f0b12d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.776439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-127c2ff5-f848-4fe1-9e6c-db6f0b12d20e None None] MFA Rules not processed for user `f930d1296fbe4539b3cdb2a292b48604`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:40.777666 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-127c2ff5-f848-4fe1-9e6c-db6f0b12d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:40.837665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:40.845821 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 560/1121] 10.222.0.78 () {58 vars in 1061 bytes} [Thu Aug 25 03:08:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:40.854524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ac6d-8c66-40c9-b5e8-a411ca8a98d0 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.865324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8ac6d-8c66-40c9-b5e8-a411ca8a98d0 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:40.869272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f930d1296fbe4539b3cdb2a292b48604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:40.869900 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.870204 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.870546 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.879703 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:40.881271 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:40.890322 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 562/1122] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:40 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:40.930298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33893656-a959-4f21-a358-84005ecca352 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:40.930585 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33893656-a959-4f21-a358-84005ecca352 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:40.930864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33893656-a959-4f21-a358-84005ecca352 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:40.932121 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 561/1123] 10.222.0.78 () {52 vars in 830 bytes} [Thu Aug 25 03:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:08:40.935543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:40.998031 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd6f5e-8e4f-4ba0-92f9-0541f6064f82 service cinder] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:41.003287 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:41.003940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:41.004224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:41.004490 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] PATH_INFO: `/v3/users/973f8d5c1d104eedbabf74f4b155e4ec` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:41.005673 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973f8d5c1d104eedbabf74f4b155e4ec)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:41.006694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:41.006694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:08:41.006694 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:08:41.007924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:41.086257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973f8d5c1d104eedbabf74f4b155e4ec'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.087035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973f8d5c1d104eedbabf74f4b155e4ec'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.111053 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973f8d5c1d104eedbabf74f4b155e4ec'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.121894 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973f8d5c1d104eedbabf74f4b155e4ec'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.147436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973f8d5c1d104eedbabf74f4b155e4ec'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.153777 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 563/1124] 10.222.0.78 () {58 vars in 1224 bytes} [Thu Aug 25 03:08:40 2022] DELETE /identity/v3/users/973f8d5c1d104eedbabf74f4b155e4ec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:41.158806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:41.159187 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:41.159476 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:41.185270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:41.186497 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:41.248409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 562/1125] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:08:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:41.258686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:41.260184 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:41.266206 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:41.322153 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711d91-b6e1-44b5-ae6d-3898b2fff0e0 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:41.326005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a15b39-885c-4930-bc29-2d5a48f6de6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:41.326619 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15b39-885c-4930-bc29-2d5a48f6de6a service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:41.326955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15b39-885c-4930-bc29-2d5a48f6de6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:41.327235 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15b39-885c-4930-bc29-2d5a48f6de6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:41.337799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a15b39-885c-4930-bc29-2d5a48f6de6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:41.339246 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a15b39-885c-4930-bc29-2d5a48f6de6a service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:41.348980 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 564/1126] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:41.694917 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:41.696513 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:41.709266 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1d94-c04d-43e1-ab1d-e516361bc170 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:41.714056 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:41.714698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:41.714981 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:41.715254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] PATH_INFO: `/v3/projects/be451bda3f5f4805b569a06b3c826e5e` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:41.716415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be451bda3f5f4805b569a06b3c826e5e)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:41.717439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:08:41.717439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:08:41.717439 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:08:41.718636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:41.784817 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be451bda3f5f4805b569a06b3c826e5e', 'request_id': 'req-e7c17407-6165-4aa6-af9f-136c9fdb024b'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.799785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be451bda3f5f4805b569a06b3c826e5e', 'request_id': 'req-e7c17407-6165-4aa6-af9f-136c9fdb024b'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.807386 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be451bda3f5f4805b569a06b3c826e5e', 'request_id': 'req-e7c17407-6165-4aa6-af9f-136c9fdb024b'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.826292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] The token cache is being invalidate because project be451bda3f5f4805b569a06b3c826e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:41.826583 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.827235 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e7c17407-6165-4aa6-af9f-136c9fdb024b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:41.828951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 563/1127] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:41 2022] DELETE /identity/v3/projects/be451bda3f5f4805b569a06b3c826e5e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:51.344570 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=25 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:51.823060 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:12.266589 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19e89-227f-442d-a4d2-5e9c05ce3769 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:12.267204 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19e89-227f-442d-a4d2-5e9c05ce3769 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:12.267204 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19e89-227f-442d-a4d2-5e9c05ce3769 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:12.268474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:12.273465 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b426a4b-f2cd-42cb-ab3a-21d8707d9aa8 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:12.273952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b426a4b-f2cd-42cb-ab3a-21d8707d9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:12.274051 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b426a4b-f2cd-42cb-ab3a-21d8707d9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:12.347690 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-8b426a4b-f2cd-42cb-ab3a-21d8707d9aa8 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:12.348926 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-8b426a4b-f2cd-42cb-ab3a-21d8707d9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:12.446278 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:10:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:12.604411 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19e89-227f-442d-a4d2-5e9c05ce3769 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:12.606097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-c1e19e89-227f-442d-a4d2-5e9c05ce3769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:12.695744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19e89-227f-442d-a4d2-5e9c05ce3769 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:12.702472 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f76ea-c664-404a-8ea8-b3555e8bbdcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:12.703082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f76ea-c664-404a-8ea8-b3555e8bbdcd service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:12.703358 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f76ea-c664-404a-8ea8-b3555e8bbdcd service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:12.703625 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f76ea-c664-404a-8ea8-b3555e8bbdcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:12.712310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f76ea-c664-404a-8ea8-b3555e8bbdcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:12.713899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f76ea-c664-404a-8ea8-b3555e8bbdcd service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:12.723108 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 566/1130] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:13.587705 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2aed6-6bdd-4e54-8138-3b63634c8eb5 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:13.588292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2aed6-6bdd-4e54-8138-3b63634c8eb5 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:13.588292 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2aed6-6bdd-4e54-8138-3b63634c8eb5 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:13.589615 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:13.594346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d702-780f-49f8-a82d-68ded73c6c20 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:13.594744 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d702-780f-49f8-a82d-68ded73c6c20 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:13.594888 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d702-780f-49f8-a82d-68ded73c6c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:13.613876 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-c4a7d702-780f-49f8-a82d-68ded73c6c20 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:13.615052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-c4a7d702-780f-49f8-a82d-68ded73c6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:13.622970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:10:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:13.818784 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2aed6-6bdd-4e54-8138-3b63634c8eb5 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:13.832615 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2aed6-6bdd-4e54-8138-3b63634c8eb5 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:13.837579 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6d299-f698-4172-aeff-3a33364d4fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:13.838166 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d299-f698-4172-aeff-3a33364d4fe3 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:13.838446 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d299-f698-4172-aeff-3a33364d4fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:13.838749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d299-f698-4172-aeff-3a33364d4fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:13.849869 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d299-f698-4172-aeff-3a33364d4fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:13.854092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d299-f698-4172-aeff-3a33364d4fe3 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:13.863787 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 566/1133] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:15.768240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8d9b-e357-4668-87d7-acf6f68b7e6e None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:15.768836 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8d9b-e357-4668-87d7-acf6f68b7e6e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:15.768836 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8d9b-e357-4668-87d7-acf6f68b7e6e None None] PATH_INFO: `/v3` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:15.770320 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 568/1134] 10.222.0.81 () {54 vars in 925 bytes} [Thu Aug 25 03:10:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:10:15.776688 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990b7c-22dc-4f6f-9f5b-bd282585a60b None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:15.777148 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990b7c-22dc-4f6f-9f5b-bd282585a60b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:15.777248 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990b7c-22dc-4f6f-9f5b-bd282585a60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:15.808017 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-73990b7c-22dc-4f6f-9f5b-bd282585a60b None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:15.809650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-73990b7c-22dc-4f6f-9f5b-bd282585a60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:15.863555 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:15.874813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 567/1135] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Aug 25 03:10:15 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:23.609260 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=42 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:25.097278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61040-4dfc-420b-bcf1-6a5a918b52e9 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:25.097895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61040-4dfc-420b-bcf1-6a5a918b52e9 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:25.097895 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61040-4dfc-420b-bcf1-6a5a918b52e9 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:25.099106 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 569/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:25.103989 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c1f3-3491-400b-b9fc-562138c971c2 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:25.104442 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c1f3-3491-400b-b9fc-562138c971c2 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:25.104552 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c1f3-3491-400b-b9fc-562138c971c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:25.124531 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b7f0c1f3-3491-400b-b9fc-562138c971c2 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:25.126450 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b7f0c1f3-3491-400b-b9fc-562138c971c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:25.135217 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 568/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:10:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:25.188716 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201debc-02c2-4755-a0c0-8dd38ecff0e1 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:25.189094 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201debc-02c2-4755-a0c0-8dd38ecff0e1 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:25.189381 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201debc-02c2-4755-a0c0-8dd38ecff0e1 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:25.190697 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 570/1138] 10.222.0.78 () {54 vars in 961 bytes} [Thu Aug 25 03:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:25.195938 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:25.196884 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:25.197170 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:25.216225 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:25.217413 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:25.225832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 569/1139] 10.222.0.78 () {58 vars in 1058 bytes} [Thu Aug 25 03:10:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:25.233279 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201debc-02c2-4755-a0c0-8dd38ecff0e1 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:25.249693 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201debc-02c2-4755-a0c0-8dd38ecff0e1 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:25.254799 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79273420-5a08-4864-890d-4ea7a3cbb1fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:25.255428 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273420-5a08-4864-890d-4ea7a3cbb1fb service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:25.255713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273420-5a08-4864-890d-4ea7a3cbb1fb service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:25.256054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273420-5a08-4864-890d-4ea7a3cbb1fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:25.265266 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273420-5a08-4864-890d-4ea7a3cbb1fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:25.266857 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273420-5a08-4864-890d-4ea7a3cbb1fb service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:25.276447 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 571/1140] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:25.294679 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:25.306890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7cec-6bd2-48b3-a609-b4e1c338262c None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:25.312109 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13cee3-caff-4af2-a54d-d91e105a5d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:25.313084 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13cee3-caff-4af2-a54d-d91e105a5d85 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:25.313084 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13cee3-caff-4af2-a54d-d91e105a5d85 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:25.313280 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13cee3-caff-4af2-a54d-d91e105a5d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:25.322073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13cee3-caff-4af2-a54d-d91e105a5d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:25.323429 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13cee3-caff-4af2-a54d-d91e105a5d85 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:25.334251 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 570/1141] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:26.174406 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0f51-9df4-4d12-a32c-69357fa2f36e None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:26.174967 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0f51-9df4-4d12-a32c-69357fa2f36e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:26.175082 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0f51-9df4-4d12-a32c-69357fa2f36e None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:26.176767 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 03:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:26.182707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce6d4-333f-44db-83e6-fa78346b48c7 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:26.183154 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce6d4-333f-44db-83e6-fa78346b48c7 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:26.183331 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce6d4-333f-44db-83e6-fa78346b48c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:26.203872 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-b55ce6d4-333f-44db-83e6-fa78346b48c7 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:26.205114 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-b55ce6d4-333f-44db-83e6-fa78346b48c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:26.213661 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 03:10:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:26.372117 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0f51-9df4-4d12-a32c-69357fa2f36e None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:26.386259 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0f51-9df4-4d12-a32c-69357fa2f36e None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:26.391298 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae6f7d-5b04-43ba-9717-30e6fa8761f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:26.391940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6f7d-5b04-43ba-9717-30e6fa8761f3 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:26.392224 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6f7d-5b04-43ba-9717-30e6fa8761f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:26.392495 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae6f7d-5b04-43ba-9717-30e6fa8761f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:26.401442 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6f7d-5b04-43ba-9717-30e6fa8761f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:26.403043 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae6f7d-5b04-43ba-9717-30e6fa8761f3 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:26.412496 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 573/1144] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:30.855539 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0da755-4de0-410d-ac50-9fc3b9db6270 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:30.856189 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0da755-4de0-410d-ac50-9fc3b9db6270 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:30.856189 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0da755-4de0-410d-ac50-9fc3b9db6270 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:30.857428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:30.862649 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a5c48-9494-4088-b737-360d18fff044 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:30.863137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a5c48-9494-4088-b737-360d18fff044 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:30.863249 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a5c48-9494-4088-b737-360d18fff044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:30.883282 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4b0a5c48-9494-4088-b737-360d18fff044 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:30.884592 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4b0a5c48-9494-4088-b737-360d18fff044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:30.892412 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:10:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:31.236123 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0da755-4de0-410d-ac50-9fc3b9db6270 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:31.237814 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-3b0da755-4de0-410d-ac50-9fc3b9db6270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:31.297269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0da755-4de0-410d-ac50-9fc3b9db6270 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:31.300689 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aa35d-f67b-4bea-a9ed-458317843c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:31.301286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa35d-f67b-4bea-a9ed-458317843c02 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:31.301560 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa35d-f67b-4bea-a9ed-458317843c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:31.301829 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa35d-f67b-4bea-a9ed-458317843c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:31.311019 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847aa35d-f67b-4bea-a9ed-458317843c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:31.312485 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847aa35d-f67b-4bea-a9ed-458317843c02 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:31.322506 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 573/1147] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:33.507209 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62773b-9ce5-4926-92b1-2f2568fe50d2 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:33.507795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62773b-9ce5-4926-92b1-2f2568fe50d2 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:33.507795 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62773b-9ce5-4926-92b1-2f2568fe50d2 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:33.509809 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:33.515130 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cca45-7db1-4555-a5ea-2bc724485fd7 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:33.515605 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cca45-7db1-4555-a5ea-2bc724485fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:33.515712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cca45-7db1-4555-a5ea-2bc724485fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:33.534577 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-7a6cca45-7db1-4555-a5ea-2bc724485fd7 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:33.535771 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-7a6cca45-7db1-4555-a5ea-2bc724485fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:33.544005 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:10:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:10:33.899115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62773b-9ce5-4926-92b1-2f2568fe50d2 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:33.901350 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-aa62773b-9ce5-4926-92b1-2f2568fe50d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:33.914852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62773b-9ce5-4926-92b1-2f2568fe50d2 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:33.918333 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92425-ed9e-4432-a8c5-0386eb87814a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:33.918922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92425-ed9e-4432-a8c5-0386eb87814a service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:33.919202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92425-ed9e-4432-a8c5-0386eb87814a service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:33.919474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92425-ed9e-4432-a8c5-0386eb87814a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:33.928123 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c92425-ed9e-4432-a8c5-0386eb87814a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:33.929542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c92425-ed9e-4432-a8c5-0386eb87814a service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:33.939197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 576/1150] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:38.043257 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bda447-8497-4644-a5d8-4155cbe59e3a None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:38.043879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bda447-8497-4644-a5d8-4155cbe59e3a None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:38.043879 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bda447-8497-4644-a5d8-4155cbe59e3a None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:38.045137 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:38.050304 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410beb5-f2b7-4e28-8dbe-dcff63797d28 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:38.050751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410beb5-f2b7-4e28-8dbe-dcff63797d28 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:38.050884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410beb5-f2b7-4e28-8dbe-dcff63797d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:38.070800 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-2410beb5-f2b7-4e28-8dbe-dcff63797d28 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:38.072034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-2410beb5-f2b7-4e28-8dbe-dcff63797d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:38.079886 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:10:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:10:38.652238 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bda447-8497-4644-a5d8-4155cbe59e3a None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:38.653911 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-85bda447-8497-4644-a5d8-4155cbe59e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:38.710689 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bda447-8497-4644-a5d8-4155cbe59e3a None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:38.714643 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c739-75e3-49f8-a2e5-9c07ee9ad994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f930d1296fbe4539b3cdb2a292b48604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:38.715241 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c739-75e3-49f8-a2e5-9c07ee9ad994 service cinder] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:38.715516 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c739-75e3-49f8-a2e5-9c07ee9ad994 service cinder] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:38.715786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c739-75e3-49f8-a2e5-9c07ee9ad994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:38.724475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c739-75e3-49f8-a2e5-9c07ee9ad994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:38.725886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c739-75e3-49f8-a2e5-9c07ee9ad994 service cinder] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:38.735810 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 576/1153] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:40.953504 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61aa1-1184-42a7-b791-972a4083ab91 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:40.954132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61aa1-1184-42a7-b791-972a4083ab91 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:40.954132 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61aa1-1184-42a7-b791-972a4083ab91 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:40.955364 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 03:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:10:40.960559 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fa54-c3e4-47a3-8ea1-bff68a77a01b None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:40.960992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fa54-c3e4-47a3-8ea1-bff68a77a01b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:40.961659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fa54-c3e4-47a3-8ea1-bff68a77a01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:40.981806 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-3e96fa54-c3e4-47a3-8ea1-bff68a77a01b None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:40.982997 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-3e96fa54-c3e4-47a3-8ea1-bff68a77a01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:40.990602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 03:10:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:41.581354 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac61aa1-1184-42a7-b791-972a4083ab91 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:41.587455 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-fac61aa1-1184-42a7-b791-972a4083ab91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:41.613244 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac61aa1-1184-42a7-b791-972a4083ab91 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:41.616655 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5375e2-d114-4b7b-bede-829c23907c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f930d1296fbe4539b3cdb2a292b48604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:41.617247 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5375e2-d114-4b7b-bede-829c23907c48 service cinder] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:41.617717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5375e2-d114-4b7b-bede-829c23907c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:41.617999 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5375e2-d114-4b7b-bede-829c23907c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:41.627801 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5375e2-d114-4b7b-bede-829c23907c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:41.629300 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5375e2-d114-4b7b-bede-829c23907c48 service cinder] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:41.638387 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 579/1156] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:50.976557 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=73 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:51.634402 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=35 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:59.180070 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6805-9fe1-493e-831a-fb40b997913e None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.180729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6805-9fe1-493e-831a-fb40b997913e None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.180729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6805-9fe1-493e-831a-fb40b997913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.200986 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f284aae-5c95-46bb-9334-ca406dd23764 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.201636 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-f91f6805-9fe1-493e-831a-fb40b997913e None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:59.201762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f284aae-5c95-46bb-9334-ca406dd23764 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.201762 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f284aae-5c95-46bb-9334-ca406dd23764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.209092 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-f91f6805-9fe1-493e-831a-fb40b997913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:59.219852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 578/1157] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:59.223476 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-2f284aae-5c95-46bb-9334-ca406dd23764 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:59.224849 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-2f284aae-5c95-46bb-9334-ca406dd23764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:59.225764 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.226053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.226405 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.232920 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 580/1158] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:59.241518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.241884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.242161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.246967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:59.248564 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:59.258590 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 579/1159] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:59.262998 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.264690 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:59.265965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:59.273032 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001292-324e-4d14-910a-8688dd6dd6d3 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.275345 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 581/1160] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:59.277656 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.278265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.278542 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.279052 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.279458 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:59.279766 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.279910 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.281394 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.289199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de57da-440a-4392-b851-8f2769ebf9f2 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.294140 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 580/1161] 10.222.0.78 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:11:59.294788 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.295401 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.295681 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.296005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] PATH_INFO: `/v3/domains` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.296686 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:59.296991 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.298032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:11:59.298032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:11:59.298032 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:11:59.298961 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.302520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.313356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619a145-c911-4e73-ab4d-78a86562b5cf admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.319909 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 582/1162] 10.222.0.78 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:11:59.322590 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.323699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.324365 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.324649 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.324919 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.325561 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.326617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:11:59.326617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:11:59.326617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:11:59.328346 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.333836 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9841cf1-825e-4c3a-9bde-c3d6888e36ff admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.338606 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.339211 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.339498 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.339770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] PATH_INFO: `/v3/projects` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.340491 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.342418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.371868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 581/1163] 10.222.0.78 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:59.374679 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.377502 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 583/1164] 10.222.0.78 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:59.382569 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.440362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3ed1-dbfb-498e-8683-1e2e9e4dce6e admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.452741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ce52-8fcb-45ea-8926-fae32ae86496 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.458701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.458701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.458701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.459249 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.459534 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.460687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:11:59.460687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:11:59.460687 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:11:59.462017 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.487863 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 584/1165] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:59.491030 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.502542 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde7e9-b708-4e0a-8828-f9ee06b74dfd admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.509170 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.509979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.510447 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.510745 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.511400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.513107 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.514020 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.514653 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.514939 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.515243 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.515931 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.517944 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.529965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 585/1166] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:11:59.531156 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.545121 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6048a68-cb89-412a-8066-b4c7748dee99 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.548775 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 582/1167] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:59.553078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.553750 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.554092 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.554433 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.555097 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.556254 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.556772 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.569394 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 586/1168] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:11:59.574600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.575761 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf60d-f07b-47c9-97fe-e6de3247525e admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.585813 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0f56-9117-4ee3-8e27-3919dbbfb3cd admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.590669 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13530ae5-d0a5-4413-8723-74e5b024091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.590886 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.591340 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13530ae5-d0a5-4413-8723-74e5b024091b admin admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.591641 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13530ae5-d0a5-4413-8723-74e5b024091b admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.591950 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.592070 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13530ae5-d0a5-4413-8723-74e5b024091b admin admin] PATH_INFO: `/v3/projects/57483250eea74c15b0f40c6e9a971c46/users/8e39cd3a7c4340eda4aa484d37465f3f/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.592438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.592921 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.594042 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.597120 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.608621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13530ae5-d0a5-4413-8723-74e5b024091b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57483250eea74c15b0f40c6e9a971c46, user_id=8e39cd3a7c4340eda4aa484d37465f3f, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.611328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13530ae5-d0a5-4413-8723-74e5b024091b admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.616482 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 583/1169] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:59.621139 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.627533 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 587/1170] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:59 2022] PUT /identity/v3/projects/57483250eea74c15b0f40c6e9a971c46/users/8e39cd3a7c4340eda4aa484d37465f3f/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:59.633373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3984-b076-4119-93d1-2b2378b3d208 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.633633 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94557be-21a0-4236-8158-882534efb536 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.633920 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94557be-21a0-4236-8158-882534efb536 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.634199 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94557be-21a0-4236-8158-882534efb536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.652973 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-e94557be-21a0-4236-8158-882534efb536 None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:59.654239 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-e94557be-21a0-4236-8158-882534efb536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:59.666795 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:59.714094 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:59.718200 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.718836 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.719117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.719388 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.720065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.721751 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.729646 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 588/1171] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:59.735431 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 584/1172] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:59.736516 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94557be-21a0-4236-8158-882534efb536 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.740936 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.748568 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94557be-21a0-4236-8158-882534efb536 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.753639 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb294c-4991-4186-83e0-90567ec49407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.754422 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb294c-4991-4186-83e0-90567ec49407 admin admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.754707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb294c-4991-4186-83e0-90567ec49407 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.755510 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb294c-4991-4186-83e0-90567ec49407 admin admin] PATH_INFO: `/v3/projects/f90e0d4ec3a04abfa4981fd914f0ec82/users/e8aabbd61ecd4ab3bcb6d33012d539c2/roles/9dab23bd829c4bd09bc84413f424696c` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.774885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb294c-4991-4186-83e0-90567ec49407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90e0d4ec3a04abfa4981fd914f0ec82, user_id=e8aabbd61ecd4ab3bcb6d33012d539c2, role_id=9dab23bd829c4bd09bc84413f424696c)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.778306 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb294c-4991-4186-83e0-90567ec49407 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.794249 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 589/1173] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:59 2022] PUT /identity/v3/projects/f90e0d4ec3a04abfa4981fd914f0ec82/users/e8aabbd61ecd4ab3bcb6d33012d539c2/roles/9dab23bd829c4bd09bc84413f424696c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:59.799728 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.800050 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.800415 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.821759 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] MFA Rules not processed for user `105b635fff904668bf368a5753e43a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:59.823099 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:59.823580 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac31e0-3b3d-4531-aae0-f664a6c9e88a admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.893822 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.894436 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.894715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.895016 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.906565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 590/1174] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:59.919696 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:59.931671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa50e5-e674-4a45-9d96-1ac5b9d76a3f None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:59.938152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ed0b6-275d-4bb8-8dd1-d4c29651ff9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:59.939141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ed0b6-275d-4bb8-8dd1-d4c29651ff9e service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:59.939578 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ed0b6-275d-4bb8-8dd1-d4c29651ff9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:59.940054 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ed0b6-275d-4bb8-8dd1-d4c29651ff9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:59.951501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ed0b6-275d-4bb8-8dd1-d4c29651ff9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.952992 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ed0b6-275d-4bb8-8dd1-d4c29651ff9e service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.963369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 591/1175] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:11:59.971724 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:59.973771 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:59.988259 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 585/1176] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:12:05.309214 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:05.310713 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:05.311140 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:05.371138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] MFA Rules not processed for user `8e39cd3a7c4340eda4aa484d37465f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:05.376698 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:05.543005 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 592/1177] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:12:05 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:05.545309 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:05.561106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978fcf-d486-46b4-b71e-29237016ca76 service neutron] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:05.587838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:05.587838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:05.587838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:05.587838 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:05.588355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:05.594529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:05.667226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 586/1178] 10.222.0.78 () {60 vars in 1153 bytes} [Thu Aug 25 03:12:05 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:12:05.673152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:05.690087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db4c3d-d2eb-47bf-801f-2c40ac8c2ef7 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:05.837793 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:05.867042 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:05.868249 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:05.869629 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:05.870080 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] PATH_INFO: `/v3/users` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:05.871074 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:05.874575 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:05.911838 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 593/1179] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:12:05 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:12:05.915861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:05.928634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75080d5e-94c2-4494-9f11-9213b741f241 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:05.934081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b61c9-2ef4-4185-9eaf-34b3bc0e323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:05.934715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b61c9-2ef4-4185-9eaf-34b3bc0e323a admin admin] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:05.934995 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b61c9-2ef4-4185-9eaf-34b3bc0e323a admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:05.935270 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b61c9-2ef4-4185-9eaf-34b3bc0e323a admin admin] PATH_INFO: `/v3/roles` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:05.935967 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b61c9-2ef4-4185-9eaf-34b3bc0e323a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:05.937992 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b61c9-2ef4-4185-9eaf-34b3bc0e323a admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:05.941409 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:05.958306 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 587/1180] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:12:05.961138 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:05.978198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1b2d-1eb5-440e-8fda-ebcc65925dee admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:05.987342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:05.988202 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:05.989204 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:05.989492 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] PATH_INFO: `/v3/projects/f8977b442abb485c8bb333e6800ae4d2/users/7a534772f2054c8baeac0b52ad4125f8/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.020397 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8977b442abb485c8bb333e6800ae4d2, user_id=7a534772f2054c8baeac0b52ad4125f8, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.026563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.059100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 594/1181] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:12:05 2022] PUT /identity/v3/projects/f8977b442abb485c8bb333e6800ae4d2/users/7a534772f2054c8baeac0b52ad4125f8/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:12:06.059518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.060236 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.060852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.079492 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.103295 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:06.106350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:06.220779 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 588/1182] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:12:06 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:06.226696 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.239215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847da01-8cef-4713-a7d8-2169457a4f16 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.244591 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1266e-e044-4d4d-9707-b4437962ab7b admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.246408 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.247651 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.248255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.248797 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] PATH_INFO: `/v3/projects` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.250832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.253329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.257141 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.257783 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.258066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.258337 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.259034 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.263197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.299473 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 595/1183] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:12:06.304363 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.312997 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 589/1184] 10.222.0.78 () {60 vars in 1153 bytes} [Thu Aug 25 03:12:06 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:12:06.314519 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.338557 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5c12-b336-406c-9401-54244d75e9b5 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.440073 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088f95-d20a-4ac5-a45f-0a8b48c1e93d admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.441052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.442046 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.442281 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.442657 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] PATH_INFO: `/v3/projects/f8977b442abb485c8bb333e6800ae4d2/users/7a534772f2054c8baeac0b52ad4125f8/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.444837 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8977b442abb485c8bb333e6800ae4d2, user_id=7a534772f2054c8baeac0b52ad4125f8, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.445813 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.446504 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.446792 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.447065 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] PATH_INFO: `/v3/users` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.447760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.448105 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.450477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.468766 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 596/1185] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:12:06 2022] PUT /identity/v3/projects/f8977b442abb485c8bb333e6800ae4d2/users/7a534772f2054c8baeac0b52ad4125f8/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:12:06.477160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 590/1186] 10.222.0.78 () {60 vars in 1144 bytes} [Thu Aug 25 03:12:06 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:12:06.481343 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.575958 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:06.608048 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac006-70fc-4ab6-83ed-8562277f6dc8 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.625965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.626351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.626636 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.628522 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.628522 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.629855 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.662701 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 597/1187] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:12:06.668607 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.689699 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139a6c-bb12-41db-9cb6-fd831a376b8e admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.697802 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.698530 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.698887 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.699175 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] PATH_INFO: `/v3/projects/d718dada831f485190fc62be598ae568/users/35b1237d32924ce0be0f69a107bec776/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.724959 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d718dada831f485190fc62be598ae568, user_id=35b1237d32924ce0be0f69a107bec776, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.727286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:12:06.727286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:12:06.727286 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:12:06.732047 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.761196 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 591/1188] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:12:06 2022] PUT /identity/v3/projects/d718dada831f485190fc62be598ae568/users/35b1237d32924ce0be0f69a107bec776/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:12:06.766479 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.784864 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1280-aa25-47b8-b161-c3046b1e98e9 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.904838 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8bac-4138-4371-93ad-8117ec7658a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.905717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8bac-4138-4371-93ad-8117ec7658a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.906015 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8bac-4138-4371-93ad-8117ec7658a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.906278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8bac-4138-4371-93ad-8117ec7658a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.907408 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a8bac-4138-4371-93ad-8117ec7658a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.909280 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a8bac-4138-4371-93ad-8117ec7658a7 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.922977 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 598/1189] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Aug 25 03:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:12:06.927907 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:06.944785 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475d1c-8831-4250-8c93-570cc440479e admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:06.949801 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:06.950475 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:06.950760 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:06.951042 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] PATH_INFO: `/v3/projects/d718dada831f485190fc62be598ae568/users/35b1237d32924ce0be0f69a107bec776/roles/7f519a00587a4cb38cff222d59894a29` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:06.953284 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d718dada831f485190fc62be598ae568, user_id=35b1237d32924ce0be0f69a107bec776, role_id=7f519a00587a4cb38cff222d59894a29)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:06.956280 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:06.971342 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 592/1190] 10.222.0.78 () {60 vars in 1483 bytes} [Thu Aug 25 03:12:06 2022] PUT /identity/v3/projects/d718dada831f485190fc62be598ae568/users/35b1237d32924ce0be0f69a107bec776/roles/7f519a00587a4cb38cff222d59894a29 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:12:13.167055 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a2d9c-b686-43f3-83d1-14e4293c3ca4 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:13.167761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a2d9c-b686-43f3-83d1-14e4293c3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:13.167761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a2d9c-b686-43f3-83d1-14e4293c3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:13.251013 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1b5a2d9c-b686-43f3-83d1-14e4293c3ca4 None None] MFA Rules not processed for user `7a534772f2054c8baeac0b52ad4125f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:13.254764 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1b5a2d9c-b686-43f3-83d1-14e4293c3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:13.470937 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 599/1191] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:12:13 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:13.483110 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:13.485515 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:13.529888 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:13.607786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e4517-8111-48e3-b908-129614abbc49 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:13.618269 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ebfffc00f19438a99c15c9e17c24719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:13.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:13.619594 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:13.620060 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:13.762602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:13.764675 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:13.783128 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 593/1192] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:13 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:13.833929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27bcc4-50f2-4ad5-94a9-fa2fa825d6df None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:13.834210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27bcc4-50f2-4ad5-94a9-fa2fa825d6df None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:13.834489 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27bcc4-50f2-4ad5-94a9-fa2fa825d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:13.872892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-6d27bcc4-50f2-4ad5-94a9-fa2fa825d6df None None] MFA Rules not processed for user `35b1237d32924ce0be0f69a107bec776`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:13.872892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-6d27bcc4-50f2-4ad5-94a9-fa2fa825d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:13.955885 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=100 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:13.986929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 600/1193] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:12:13 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:13.997709 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:14.008487 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f2dd2-5eef-4614-81a3-384f79a6efcb service glance] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:14.015188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7384e2-1533-464a-8cbe-675714fd52e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ebfffc00f19438a99c15c9e17c24719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:14.016132 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7384e2-1533-464a-8cbe-675714fd52e0 service glance] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:14.016640 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7384e2-1533-464a-8cbe-675714fd52e0 service glance] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:14.017261 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7384e2-1533-464a-8cbe-675714fd52e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:14.127276 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7384e2-1533-464a-8cbe-675714fd52e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:14.130427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7384e2-1533-464a-8cbe-675714fd52e0 service glance] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:14.193274 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 594/1194] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:13 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:22.558753 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e316-20e1-4dbe-a080-e85e3da7d9d2 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:22.559324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e316-20e1-4dbe-a080-e85e3da7d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:22.559324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e316-20e1-4dbe-a080-e85e3da7d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:22.580760 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-7d91e316-20e1-4dbe-a080-e85e3da7d9d2 None None] MFA Rules not processed for user `8e39cd3a7c4340eda4aa484d37465f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:22.582578 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-7d91e316-20e1-4dbe-a080-e85e3da7d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:22.590040 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 601/1195] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:12:22 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:22.967231 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fee86-fbd2-4079-85d1-9e4262f34177 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:22.969113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fee86-fbd2-4079-85d1-9e4262f34177 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:22.969113 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fee86-fbd2-4079-85d1-9e4262f34177 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:22.970949 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 595/1196] 10.222.0.78 () {54 vars in 962 bytes} [Thu Aug 25 03:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:12:22.976023 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f1672-9de4-494b-a91c-8cc94ba4a470 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:22.976316 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f1672-9de4-494b-a91c-8cc94ba4a470 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:22.976600 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f1672-9de4-494b-a91c-8cc94ba4a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.028751 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-bb5f1672-9de4-494b-a91c-8cc94ba4a470 None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:23.030541 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-bb5f1672-9de4-494b-a91c-8cc94ba4a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:23.124001 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 602/1197] 10.222.0.78 () {58 vars in 1059 bytes} [Thu Aug 25 03:12:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:23.127503 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788085-25f9-4451-933d-9123a6b1d291 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:23.127786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788085-25f9-4451-933d-9123a6b1d291 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:23.128111 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788085-25f9-4451-933d-9123a6b1d291 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.129529 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 596/1198] 10.222.0.78 () {54 vars in 912 bytes} [Thu Aug 25 03:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:12:23.135398 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41868c-ba53-4fac-8b2f-c95c5344f78e None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:23.135768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41868c-ba53-4fac-8b2f-c95c5344f78e None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:23.136294 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41868c-ba53-4fac-8b2f-c95c5344f78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.157351 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-5f41868c-ba53-4fac-8b2f-c95c5344f78e None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:23.158501 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-5f41868c-ba53-4fac-8b2f-c95c5344f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:23.167628 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 603/1199] 10.222.0.78 () {58 vars in 1009 bytes} [Thu Aug 25 03:12:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:23.182894 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788085-25f9-4451-933d-9123a6b1d291 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:23.185415 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-24788085-25f9-4451-933d-9123a6b1d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:23.204290 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788085-25f9-4451-933d-9123a6b1d291 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:23.208149 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260edca9-b6f7-4cb3-b02a-954d69361101 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ebfffc00f19438a99c15c9e17c24719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:23.208793 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260edca9-b6f7-4cb3-b02a-954d69361101 service glance] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:23.209076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260edca9-b6f7-4cb3-b02a-954d69361101 service glance] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:23.209351 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260edca9-b6f7-4cb3-b02a-954d69361101 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.220122 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260edca9-b6f7-4cb3-b02a-954d69361101 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:23.221602 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260edca9-b6f7-4cb3-b02a-954d69361101 service glance] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:23.232456 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 597/1200] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:23.624752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6029-3f20-47a2-a26f-beb56653cfcc None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:23.625899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6029-3f20-47a2-a26f-beb56653cfcc None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:23.626536 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6029-3f20-47a2-a26f-beb56653cfcc None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.628944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 604/1201] 10.222.0.78 () {54 vars in 912 bytes} [Thu Aug 25 03:12:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:12:23.635302 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccfe8-80d5-45ac-87a3-0c1f97864528 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:23.635852 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccfe8-80d5-45ac-87a3-0c1f97864528 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:23.636420 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccfe8-80d5-45ac-87a3-0c1f97864528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.675234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a35ccfe8-80d5-45ac-87a3-0c1f97864528 None None] MFA Rules not processed for user `4fab6f04a71044c8a5c16944dc5fb349`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:23.676684 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a35ccfe8-80d5-45ac-87a3-0c1f97864528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:23.716025 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=100 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:23.752214 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 598/1202] 10.222.0.78 () {58 vars in 1009 bytes} [Thu Aug 25 03:12:23 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:12:23.764546 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca6029-3f20-47a2-a26f-beb56653cfcc None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:23.776922 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca6029-3f20-47a2-a26f-beb56653cfcc None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:23.781208 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876aefcb-d064-4561-8194-90a2d3d36e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:23.781969 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aefcb-d064-4561-8194-90a2d3d36e43 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:23.782343 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aefcb-d064-4561-8194-90a2d3d36e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:23.783240 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aefcb-d064-4561-8194-90a2d3d36e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:23.793342 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876aefcb-d064-4561-8194-90a2d3d36e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:23.794874 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876aefcb-d064-4561-8194-90a2d3d36e43 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:23.803295 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 605/1203] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:23 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:24.220812 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795673b-32aa-4b7b-b2af-a47b2be7d69c None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.222522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795673b-32aa-4b7b-b2af-a47b2be7d69c None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.222522 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795673b-32aa-4b7b-b2af-a47b2be7d69c None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.223357 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 599/1204] 10.222.0.78 () {54 vars in 962 bytes} [Thu Aug 25 03:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:12:24.231722 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd602c-7cec-4aee-a29b-129f73105b3c None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.232033 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd602c-7cec-4aee-a29b-129f73105b3c None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.232310 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd602c-7cec-4aee-a29b-129f73105b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.261329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bccbf-b24b-4517-a38d-bfdc5dbcc6a6 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.261627 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bccbf-b24b-4517-a38d-bfdc5dbcc6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.261954 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bccbf-b24b-4517-a38d-bfdc5dbcc6a6 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.263398 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 600/1205] 10.222.0.78 () {54 vars in 961 bytes} [Thu Aug 25 03:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:12:24.265019 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-17fd602c-7cec-4aee-a29b-129f73105b3c None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:24.266278 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-17fd602c-7cec-4aee-a29b-129f73105b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:24.269226 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500419-f1ca-41d1-904d-fedb869ae427 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.269620 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500419-f1ca-41d1-904d-fedb869ae427 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.270035 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500419-f1ca-41d1-904d-fedb869ae427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.276770 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 606/1206] 10.222.0.78 () {58 vars in 1059 bytes} [Thu Aug 25 03:12:24 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:24.282502 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd383-eb0a-4685-a415-4a8f7a7737a7 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.282797 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd383-eb0a-4685-a415-4a8f7a7737a7 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.283081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd383-eb0a-4685-a415-4a8f7a7737a7 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.284647 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 607/1207] 10.222.0.78 () {54 vars in 912 bytes} [Thu Aug 25 03:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:12:24.289829 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.290206 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.290594 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.291890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-52500419-f1ca-41d1-904d-fedb869ae427 None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:24.293268 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-52500419-f1ca-41d1-904d-fedb869ae427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:24.314115 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:24.318462 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:24.325863 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 608/1208] 10.222.0.78 () {58 vars in 1009 bytes} [Thu Aug 25 03:12:24 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:12:24.337955 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:24.351414 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6042-1218-40c5-a76d-a3d34ab2f2e7 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:24.356035 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:24.356761 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.357037 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.357314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.369021 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:24.370503 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:24.383359 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 609/1209] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:24.386749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 601/1210] 10.222.0.78 () {58 vars in 1058 bytes} [Thu Aug 25 03:12:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:12:24.387678 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:24.399500 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae9a0d-bf53-47c5-a377-92bc3d5f8e27 service neutron] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:24.405399 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:24.406007 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:24.406281 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:24.406555 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:24.408334 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:24.420283 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:24.421878 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:24.432979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 610/1211] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:24 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:34.369756 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=36 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:34.429954 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=70 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:37.357321 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3da2d4-70af-4174-a0d4-6c9013902be3 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:37.357902 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3da2d4-70af-4174-a0d4-6c9013902be3 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:37.357902 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3da2d4-70af-4174-a0d4-6c9013902be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:37.379703 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-1c3da2d4-70af-4174-a0d4-6c9013902be3 None None] MFA Rules not processed for user `4fab6f04a71044c8a5c16944dc5fb349`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:37.380950 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-1c3da2d4-70af-4174-a0d4-6c9013902be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:37.387385 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 602/1212] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Aug 25 03:12:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:12:37.401631 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:37.413078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87533c-3edc-4932-a4b7-960d91f5ffcd service placement] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:37.418470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3100f-d1dd-4425-8a40-71077a683738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:37.419145 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3100f-d1dd-4425-8a40-71077a683738 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:37.419555 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3100f-d1dd-4425-8a40-71077a683738 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:37.419863 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3100f-d1dd-4425-8a40-71077a683738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:37.427297 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3100f-d1dd-4425-8a40-71077a683738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:37.428752 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3100f-d1dd-4425-8a40-71077a683738 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:37.436638 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 611/1213] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:37 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:38.296951 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166ad28-8775-4c5d-bfea-be6c3d41101a None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:38.297239 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166ad28-8775-4c5d-bfea-be6c3d41101a None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:38.297508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166ad28-8775-4c5d-bfea-be6c3d41101a None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:38.299095 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 603/1214] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:12:38.352906 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b646-030a-4031-8d6d-e0ee2429fab7 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:38.353464 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b646-030a-4031-8d6d-e0ee2429fab7 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:38.353979 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b646-030a-4031-8d6d-e0ee2429fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:38.377845 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-7f20b646-030a-4031-8d6d-e0ee2429fab7 None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:38.379140 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-7f20b646-030a-4031-8d6d-e0ee2429fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:38.389406 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 612/1215] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:12:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:38.413634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166ad28-8775-4c5d-bfea-be6c3d41101a None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:38.433052 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166ad28-8775-4c5d-bfea-be6c3d41101a None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:38.442298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf24d8-3810-4276-88a8-814d06b46ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:38.442926 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf24d8-3810-4276-88a8-814d06b46ba8 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:38.443206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf24d8-3810-4276-88a8-814d06b46ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:38.443479 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf24d8-3810-4276-88a8-814d06b46ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:38.452861 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf24d8-3810-4276-88a8-814d06b46ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:38.454830 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf24d8-3810-4276-88a8-814d06b46ba8 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:38.468188 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 604/1216] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:46.336212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d838213-db08-4510-b494-3468e4af8660 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:46.336212 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d838213-db08-4510-b494-3468e4af8660 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:46.337263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d838213-db08-4510-b494-3468e4af8660 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:46.337785 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 613/1217] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:12:46.350718 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:46.351528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:46.351528 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:46.378608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:12:46.380178 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:12:46.389672 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 605/1218] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:12:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:12:46.410347 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d838213-db08-4510-b494-3468e4af8660 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:12:46.436920 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d838213-db08-4510-b494-3468e4af8660 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:12:46.443505 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eaec2-caf9-4e4b-8fde-fa11db85e0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:12:46.444274 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eaec2-caf9-4e4b-8fde-fa11db85e0f3 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:12:46.444614 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eaec2-caf9-4e4b-8fde-fa11db85e0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:12:46.444946 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eaec2-caf9-4e4b-8fde-fa11db85e0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:12:46.455147 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eaec2-caf9-4e4b-8fde-fa11db85e0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:12:46.456469 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eaec2-caf9-4e4b-8fde-fa11db85e0f3 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:12:46.468068 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 614/1219] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:12:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:12:56.371723 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=12 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:56.463394 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=15 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:01.234634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:13:01.244646 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b445-02e6-45f6-8712-3722a90db2e4 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:13:01.248566 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dc8ef-909c-4e2e-9aa4-e3be1c50245a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:13:01.249244 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc8ef-909c-4e2e-9aa4-e3be1c50245a service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:13:01.249608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc8ef-909c-4e2e-9aa4-e3be1c50245a service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:13:01.249885 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc8ef-909c-4e2e-9aa4-e3be1c50245a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:13:01.260617 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5dc8ef-909c-4e2e-9aa4-e3be1c50245a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:13:01.262044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5dc8ef-909c-4e2e-9aa4-e3be1c50245a service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:13:01.276026 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 606/1220] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:13:01 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:13:11.268116 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=6 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:19.769470 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:13:19.770166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:13:19.770166 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:13:19.788746 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:13:19.789962 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:13:19.796974 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 615/1221] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:13:19 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:13:20.115595 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94668e0-4404-4f82-9b89-022acb7372a1 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:13:20.116489 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94668e0-4404-4f82-9b89-022acb7372a1 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:13:20.116652 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94668e0-4404-4f82-9b89-022acb7372a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:13:20.137707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-d94668e0-4404-4f82-9b89-022acb7372a1 None None] MFA Rules not processed for user `4fab6f04a71044c8a5c16944dc5fb349`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:13:20.138955 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-d94668e0-4404-4f82-9b89-022acb7372a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:13:20.145520 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 607/1222] 10.222.0.78 () {58 vars in 1009 bytes} [Thu Aug 25 03:13:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:13:20.158365 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:13:20.169563 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fac62-65ab-477f-b956-4ca1b5a26ed6 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:13:20.174311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfacfe-cf2f-480d-9aa9-7801eb107f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:13:20.174913 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfacfe-cf2f-480d-9aa9-7801eb107f3a service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:13:20.175188 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfacfe-cf2f-480d-9aa9-7801eb107f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:13:20.175455 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfacfe-cf2f-480d-9aa9-7801eb107f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:13:20.184314 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfacfe-cf2f-480d-9aa9-7801eb107f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:13:20.185753 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfacfe-cf2f-480d-9aa9-7801eb107f3a service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:13:20.193940 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 616/1223] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:13:20 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:13:30.131523 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:30.190419 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=9 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:47.683263 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a783ee-6b8d-42bf-b4cf-816abc6c0809 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:13:47.683726 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a783ee-6b8d-42bf-b4cf-816abc6c0809 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:13:47.683828 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a783ee-6b8d-42bf-b4cf-816abc6c0809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:13:47.704518 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-a3a783ee-6b8d-42bf-b4cf-816abc6c0809 None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:13:47.705719 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-a3a783ee-6b8d-42bf-b4cf-816abc6c0809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:13:47.713936 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 608/1224] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:13:47 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:13:57.700076 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:03.474565 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:14:03.475092 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:14:03.475092 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:14:03.495548 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:14:03.496844 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:14:03.503907 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 617/1225] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:14:03 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:14:13.490057 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=3 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:03.944160 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499bb8-2e3b-41e9-96ae-6525783d15ab None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:15:03.944747 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499bb8-2e3b-41e9-96ae-6525783d15ab None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:15:03.944747 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499bb8-2e3b-41e9-96ae-6525783d15ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:15:03.966099 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-0c499bb8-2e3b-41e9-96ae-6525783d15ab None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:15:03.967329 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-0c499bb8-2e3b-41e9-96ae-6525783d15ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:15:03.974956 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 609/1226] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:15:03 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:15:13.960587 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:18.100161 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:15:18.120328 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72a4d-71cb-4d67-afaa-b2888c60ed7d None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:15:18.124078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8cdde-6bef-4d52-ac09-49d29b884496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:15:18.124688 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cdde-6bef-4d52-ac09-49d29b884496 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:15:18.124982 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cdde-6bef-4d52-ac09-49d29b884496 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:15:18.125251 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cdde-6bef-4d52-ac09-49d29b884496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:15:18.135543 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8cdde-6bef-4d52-ac09-49d29b884496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:15:18.137020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8cdde-6bef-4d52-ac09-49d29b884496 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:15:18.146970 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 618/1227] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:15:18 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:15:20.180106 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303be17-3fce-456e-92f5-9a83ebb5ee32 None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:15:20.180611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303be17-3fce-456e-92f5-9a83ebb5ee32 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:15:20.180611 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303be17-3fce-456e-92f5-9a83ebb5ee32 None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:15:20.182343 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 610/1228] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:15:20.188231 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:15:20.188677 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:15:20.189009 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:15:20.249171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] MFA Rules not processed for user `f197d1797b6044b494fdff7290d66a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:15:20.250385 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:15:20.281924 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 619/1229] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:15:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:15:20.294393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303be17-3fce-456e-92f5-9a83ebb5ee32 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:15:20.309781 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303be17-3fce-456e-92f5-9a83ebb5ee32 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:15:20.316315 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:15:20.316953 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:15:20.317232 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:15:20.317581 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:15:20.327376 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:15:20.329090 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:15:20.340955 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 611/1230] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:15:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:15:30.278535 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=27 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:30.336169 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=6 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:20.080137 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:16:20.101203 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e868-71aa-4e71-a1cb-1871c9e9e750 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:16:20.106185 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:16:20.106793 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:16:20.107072 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:16:20.107343 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:16:20.116991 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:16:20.118627 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:16:20.130116 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 620/1231] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:16:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:16:30.124879 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=10 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:25.273017 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:25.285044 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bee659-39a9-4b1d-9849-42965bd80cd1 service nova] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:25.291416 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:25.292089 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:25.292390 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:25.292693 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:25.302726 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:25.304759 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:25.315234 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 612/1232] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:25 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:17:25.523658 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:25.536155 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445e36-9aea-44fe-b786-70a879a7f3e8 service placement] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:25.540067 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a080-b6c7-4eef-a532-1c5aa3dba001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:25.540888 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a080-b6c7-4eef-a532-1c5aa3dba001 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:25.541171 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a080-b6c7-4eef-a532-1c5aa3dba001 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:25.541450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a080-b6c7-4eef-a532-1c5aa3dba001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:25.553060 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a080-b6c7-4eef-a532-1c5aa3dba001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:25.554513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a080-b6c7-4eef-a532-1c5aa3dba001 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:25.565493 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 621/1233] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:17:26.798698 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:26.814037 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06c572-1b27-47a9-b9cc-fb897ef4a278 service nova] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:26.817732 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:26.818352 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:26.818634 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:26.818906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:26.835295 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:26.838081 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:26.855540 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 613/1234] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:26 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:17:30.596205 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:30.596967 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:30.596967 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:30.618747 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:17:30.620322 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:17:30.628377 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 622/1235] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:17:30 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:17:31.742558 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:31.756870 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2717ede-f457-407a-bcc9-237b0e198e31 service neutron] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:31.763588 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:31.764438 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:31.764832 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:31.765221 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:31.776864 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:31.779356 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:31.792298 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 614/1236] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:17:40.612933 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=9 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:41.786848 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=18 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:42.044858 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:42.057997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ad79-c019-4370-b9fa-8220c70cf561 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:42.062169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:42.063157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:42.063642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:42.064169 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:42.077083 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:42.079158 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:42.091997 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 623/1237] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:42 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:17:46.315678 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:46.336034 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539b436-7313-45fa-89ed-6d958578f11e service placement] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:46.348748 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7a0f2-b1cf-4b8a-b961-143891560161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:46.349690 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a0f2-b1cf-4b8a-b961-143891560161 service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:46.350354 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a0f2-b1cf-4b8a-b961-143891560161 service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:46.350983 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7a0f2-b1cf-4b8a-b961-143891560161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:46.366215 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7a0f2-b1cf-4b8a-b961-143891560161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:46.369184 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7a0f2-b1cf-4b8a-b961-143891560161 service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:46.388576 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 615/1238] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:17:47.406116 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:17:47.431400 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827ab18-717a-463a-a322-b531c3cb007a service neutron] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:17:47.441966 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:17:47.443248 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:17:47.443953 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:17:47.444621 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:17:47.458309 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:17:47.460121 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:17:47.472409 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 624/1239] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:17:47 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:17:56.379708 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=6 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:57.467794 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=12 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:04.317236 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:18:04.317890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:18:04.317890 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:18:04.341673 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] MFA Rules not processed for user `8e39cd3a7c4340eda4aa484d37465f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:18:04.343163 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:18:04.350350 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 616/1240] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:18:04 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:18:04.608346 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:18:04.618101 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93136-f06c-4c8e-88f0-114c4715c024 service nova] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:18:04.621680 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:18:04.622273 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:18:04.622552 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:18:04.622821 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:18:04.629806 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:18:04.631225 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:18:04.638882 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 625/1241] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:18:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:18:14.336155 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:14.635617 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=6 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:23.917396 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:18:23.931373 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2f02-c59a-4103-879f-cb68775d76b4 None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:18:23.937059 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824a2d-3de7-4362-b411-2bd95359224c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:18:23.937670 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824a2d-3de7-4362-b411-2bd95359224c service nova] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:18:23.937952 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824a2d-3de7-4362-b411-2bd95359224c service nova] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:18:23.938229 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824a2d-3de7-4362-b411-2bd95359224c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:18:23.948499 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3824a2d-3de7-4362-b411-2bd95359224c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:18:23.950087 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3824a2d-3de7-4362-b411-2bd95359224c service nova] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:18:23.960945 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 617/1242] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:18:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:18:33.077052 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:18:33.085629 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349d8a-faab-420d-9365-79462ff40e4a service neutron] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:18:33.090856 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:18:33.091448 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:18:33.091725 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:18:33.092020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:18:33.101637 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:18:33.103655 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:18:33.116134 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 626/1243] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:18:33 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:18:33.956022 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=6 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:43.110066 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=6 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:38.817105 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:19:38.817739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:19:38.817739 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:19:38.836142 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] MFA Rules not processed for user `e8aabbd61ecd4ab3bcb6d33012d539c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:19:38.837307 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:19:38.844146 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 618/1244] 10.222.0.78 () {58 vars in 958 bytes} [Thu Aug 25 03:19:38 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:19:48.831362 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:18.167467 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:18.224266 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8915e-9236-4ee1-8dc2-9c4f08b9bac2 service neutron] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:18.229406 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8228-a4c9-4bf9-ae92-0688b41bda93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f197d1797b6044b494fdff7290d66a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:18.230016 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8228-a4c9-4bf9-ae92-0688b41bda93 service nova] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:18.230305 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8228-a4c9-4bf9-ae92-0688b41bda93 service nova] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:18.230580 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8228-a4c9-4bf9-ae92-0688b41bda93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:18.239944 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8228-a4c9-4bf9-ae92-0688b41bda93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:18.241528 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8228-a4c9-4bf9-ae92-0688b41bda93 service nova] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:18.251768 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 627/1245] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:21:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:21:19.403608 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:19.405265 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:19.440965 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8349b-a831-4cf4-a92e-8e3df24944be None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:19.444554 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4286b-494d-4b42-9b15-4b276a98498c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:19.445163 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4286b-494d-4b42-9b15-4b276a98498c service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:19.445444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4286b-494d-4b42-9b15-4b276a98498c service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:19.445746 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4286b-494d-4b42-9b15-4b276a98498c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:19.514727 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4286b-494d-4b42-9b15-4b276a98498c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:19.516131 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4286b-494d-4b42-9b15-4b276a98498c service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:19.535639 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 619/1246] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:21:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:21:22.908192 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c1fce-c6bc-45b8-8ef9-eac892ebefe5 None None] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:22.909257 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c1fce-c6bc-45b8-8ef9-eac892ebefe5 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:22.910311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c1fce-c6bc-45b8-8ef9-eac892ebefe5 None None] PATH_INFO: `/` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:22.912263 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 628/1247] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:21:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:21:22.922127 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfbd1a-6ad4-489a-9712-525a59e3f101 None None] REQUEST_METHOD: `POST` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:22.922651 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfbd1a-6ad4-489a-9712-525a59e3f101 None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:22.922729 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfbd1a-6ad4-489a-9712-525a59e3f101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:22.998567 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.auth.core [None req-e2cfbd1a-6ad4-489a-9712-525a59e3f101 None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:21:23.000622 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e2cfbd1a-6ad4-489a-9712-525a59e3f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:23.010988 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 620/1248] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:21:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:21:23.047324 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c1fce-c6bc-45b8-8ef9-eac892ebefe5 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:23.061437 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c1fce-c6bc-45b8-8ef9-eac892ebefe5 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:23.067604 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2be66e-e2b3-420b-b9d8-0ee5be89f8c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:23.069096 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be66e-e2b3-420b-b9d8-0ee5be89f8c5 service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:23.069671 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be66e-e2b3-420b-b9d8-0ee5be89f8c5 service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:23.070197 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be66e-e2b3-420b-b9d8-0ee5be89f8c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:23.081234 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2be66e-e2b3-420b-b9d8-0ee5be89f8c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:23.084571 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2be66e-e2b3-420b-b9d8-0ee5be89f8c5 service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:23.098884 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 629/1249] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:21:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:21:26.310665 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926c91-30c6-4163-bb87-9421163fe20b None None] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:26.311224 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926c91-30c6-4163-bb87-9421163fe20b None None] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:26.311224 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926c91-30c6-4163-bb87-9421163fe20b None None] PATH_INFO: `/` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:26.312707 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 621/1250] 10.222.0.78 () {54 vars in 921 bytes} [Thu Aug 25 03:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:21:26.344154 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] REQUEST_METHOD: `POST` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:26.344707 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:26.344899 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:26.367947 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.auth.core [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] MFA Rules not processed for user `896d8a3a5f9a45439eaf17c173e6c202`. Rule list: `[]` (Enabled: `True`). {{(pid=88521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:21:26.368943 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:26.379471 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926c91-30c6-4163-bb87-9421163fe20b None None] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:26.381929 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 630/1251] 10.222.0.78 () {58 vars in 1018 bytes} [Thu Aug 25 03:21:26 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:21:26.392508 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926c91-30c6-4163-bb87-9421163fe20b None None] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:26.400553 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:26.401289 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:26.401929 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:26.402206 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:26.402477 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] PATH_INFO: `/v3/users/8e39cd3a7c4340eda4aa484d37465f3f` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:26.403650 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e39cd3a7c4340eda4aa484d37465f3f)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:26.405096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: WARNING py.warnings [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:21:26.405096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: warnings.warn(msg) Aug 25 03:21:26.405096 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: Aug 25 03:21:26.406683 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:26.411720 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685462-fb21-4eb0-ac78-3a469359c316 None None] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:26.416741 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:26.417348 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:26.417627 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:26.417896 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:26.426555 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:26.428157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:26.437524 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 631/1252] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:21:26 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:21:26.473677 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e39cd3a7c4340eda4aa484d37465f3f'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.491621 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e39cd3a7c4340eda4aa484d37465f3f'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.497649 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:26.502976 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e39cd3a7c4340eda4aa484d37465f3f'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.510776 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e39cd3a7c4340eda4aa484d37465f3f'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.511412 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e39cd3a7c4340eda4aa484d37465f3f'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.517410 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 622/1253] 10.222.0.78 () {58 vars in 1224 bytes} [Thu Aug 25 03:21:26 2022] DELETE /identity/v3/users/8e39cd3a7c4340eda4aa484d37465f3f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:21:26.692065 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:26.703373 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2fc97-46fe-4532-b783-95436d698f09 service placement] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:26.772518 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:26.773143 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:26.773423 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:26.773717 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] PATH_INFO: `/v3/projects/57483250eea74c15b0f40c6e9a971c46` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:26.774835 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57483250eea74c15b0f40c6e9a971c46)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:26.775890 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: WARNING py.warnings [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:21:26.775890 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: warnings.warn(msg) Aug 25 03:21:26.775890 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: Aug 25 03:21:26.777100 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:26.837325 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57483250eea74c15b0f40c6e9a971c46', 'request_id': 'req-5eb768f6-8a86-4838-9776-142332bb3b5e'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.846618 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57483250eea74c15b0f40c6e9a971c46', 'request_id': 'req-5eb768f6-8a86-4838-9776-142332bb3b5e'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.856506 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57483250eea74c15b0f40c6e9a971c46', 'request_id': 'req-5eb768f6-8a86-4838-9776-142332bb3b5e'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.888369 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] The token cache is being invalidate because project 57483250eea74c15b0f40c6e9a971c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:21:26.888642 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.889272 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:26.890778 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 632/1254] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Aug 25 03:21:26 2022] DELETE /identity/v3/projects/57483250eea74c15b0f40c6e9a971c46 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:21:26.895444 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:26.896969 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:26.910172 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c79a-0453-4072-b994-aea485c301d8 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:26.967856 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:26.968427 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:26.968712 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:26.968984 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] PATH_INFO: `/v3/users/7a534772f2054c8baeac0b52ad4125f8` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:26.970126 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a534772f2054c8baeac0b52ad4125f8)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:26.972141 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:27.023167 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a534772f2054c8baeac0b52ad4125f8'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.043544 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a534772f2054c8baeac0b52ad4125f8'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.052772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a534772f2054c8baeac0b52ad4125f8'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.061392 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a534772f2054c8baeac0b52ad4125f8'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.062501 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a534772f2054c8baeac0b52ad4125f8'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.069368 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 623/1255] 10.222.0.78 () {58 vars in 1224 bytes} [Thu Aug 25 03:21:26 2022] DELETE /identity/v3/users/7a534772f2054c8baeac0b52ad4125f8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:21:27.087338 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:27.088839 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:27.095158 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:27.168078 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb768f6-8a86-4838-9776-142332bb3b5e admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:27.240715 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:27.241397 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:27.241755 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:27.242081 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:27.244020 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:27.257311 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:27.258963 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:27.264837 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:21:27.267279 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:21:27.270519 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 633/1256] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:21:27 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:21:27.339334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25e6b8-2adc-4597-a3f1-ef1854092329 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:21:27.344786 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:21:27.345428 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:21:27.345736 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:21:27.346007 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] PATH_INFO: `/v3/projects/f8977b442abb485c8bb333e6800ae4d2` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:21:27.347284 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8977b442abb485c8bb333e6800ae4d2)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:21:27.349772 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:21:27.358627 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:27.400868 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8977b442abb485c8bb333e6800ae4d2', 'request_id': 'req-8fbc71c5-145c-43b3-87c2-1919db95e28c'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.407255 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8977b442abb485c8bb333e6800ae4d2', 'request_id': 'req-8fbc71c5-145c-43b3-87c2-1919db95e28c'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.413749 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8977b442abb485c8bb333e6800ae4d2', 'request_id': 'req-8fbc71c5-145c-43b3-87c2-1919db95e28c'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.429334 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] The token cache is being invalidate because project f8977b442abb485c8bb333e6800ae4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:21:27.429816 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.430841 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:21:27.432835 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 624/1257] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Aug 25 03:21:27 2022] DELETE /identity/v3/projects/f8977b442abb485c8bb333e6800ae4d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:21:37.267039 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=57 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:37.424659 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:26.031295 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:22:26.032802 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:26.118517 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3995df-992b-4d81-8456-25ae6a504fab service placement] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:22:26.169558 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f930d1296fbe4539b3cdb2a292b48604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:22:26.170164 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:22:26.170436 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:22:26.170704 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:22:26.172525 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:26.261249 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:22:26.263087 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:22:26.284852 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 634/1258] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:22:26 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:22:27.601469 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:22:27.602934 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:27.676715 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc71c5-145c-43b3-87c2-1919db95e28c admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:22:27.680260 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab6f04a71044c8a5c16944dc5fb349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:22:27.680866 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] REQUEST_METHOD: `GET` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:22:27.681140 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:22:27.681411 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:22:27.683296 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:27.746652 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:22:27.748117 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:22:27.757693 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 625/1259] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:22:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:22:35.074892 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:22:35.077965 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:35.093896 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74008ce7-7513-4569-9211-7b921ef2962d service cinder] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:22:35.099085 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:22:35.099734 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:22:35.100023 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:22:35.100355 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] PATH_INFO: `/v3/users/e8aabbd61ecd4ab3bcb6d33012d539c2` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:22:35.101474 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8aabbd61ecd4ab3bcb6d33012d539c2)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:22:35.103452 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:22:35.121479 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:35.172910 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8aabbd61ecd4ab3bcb6d33012d539c2'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.174017 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8aabbd61ecd4ab3bcb6d33012d539c2'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.186513 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8aabbd61ecd4ab3bcb6d33012d539c2'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.203991 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8aabbd61ecd4ab3bcb6d33012d539c2'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.219861 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8aabbd61ecd4ab3bcb6d33012d539c2'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.226041 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 635/1260] 10.222.0.78 () {58 vars in 1224 bytes} [Thu Aug 25 03:22:35 2022] DELETE /identity/v3/users/e8aabbd61ecd4ab3bcb6d33012d539c2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:22:35.438227 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:22:35.452645 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e68a8-dc7b-4268-9ef5-90cbba2e6e36 service neutron] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:22:35.524908 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:22:35.525648 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:22:35.525930 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:22:35.526264 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] PATH_INFO: `/v3/projects/f90e0d4ec3a04abfa4981fd914f0ec82` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:22:35.527461 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90e0d4ec3a04abfa4981fd914f0ec82)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:22:35.529440 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:22:35.591863 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:35.603789 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90e0d4ec3a04abfa4981fd914f0ec82', 'request_id': 'req-e284e327-52b3-4672-a6a6-6e7b2a9d9945'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.610801 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90e0d4ec3a04abfa4981fd914f0ec82', 'request_id': 'req-e284e327-52b3-4672-a6a6-6e7b2a9d9945'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.617416 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90e0d4ec3a04abfa4981fd914f0ec82', 'request_id': 'req-e284e327-52b3-4672-a6a6-6e7b2a9d9945'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.636340 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] The token cache is being invalidate because project f90e0d4ec3a04abfa4981fd914f0ec82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:22:35.636633 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.637385 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.638949 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 626/1261] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Aug 25 03:22:35 2022] DELETE /identity/v3/projects/f90e0d4ec3a04abfa4981fd914f0ec82 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:22:35.643152 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:22:35.645198 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:35.666475 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7aff-79ab-4afe-b5e9-70a2026b8776 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:22:35.759148 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:22:35.759796 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:22:35.760110 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:22:35.760390 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] PATH_INFO: `/v3/users/35b1237d32924ce0be0f69a107bec776` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:22:35.782814 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b1237d32924ce0be0f69a107bec776)` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:22:35.786700 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:22:35.866268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b1237d32924ce0be0f69a107bec776'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.867268 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b1237d32924ce0be0f69a107bec776'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.880805 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b1237d32924ce0be0f69a107bec776'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.892450 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b1237d32924ce0be0f69a107bec776'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.908113 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.notifications [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b1237d32924ce0be0f69a107bec776'} {{(pid=88521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:35.915157 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 636/1262] 10.222.0.78 () {58 vars in 1224 bytes} [Thu Aug 25 03:22:35 2022] DELETE /identity/v3/users/35b1237d32924ce0be0f69a107bec776 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:22:36.136906 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Authenticating user token {{(pid=88522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:22:36.138820 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.fernet_utils [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:22:36.153667 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e327-52b3-4672-a6a6-6e7b2a9d9945 admin admin] Validating token access rules against request {{(pid=88522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:22:36.241514 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105b635fff904668bf368a5753e43a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ada4f5619714b09af4deed40278da87', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:22:36.242156 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:22:36.242434 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] SCRIPT_NAME: `/identity` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:22:36.242710 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] PATH_INFO: `/v3/projects/d718dada831f485190fc62be598ae568` {{(pid=88522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:22:36.254345 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d718dada831f485190fc62be598ae568)` {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:22:36.256337 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] RBAC: Authorization granted {{(pid=88522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:22:36.319791 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd718dada831f485190fc62be598ae568', 'request_id': 'req-68b31753-a4a0-4b8a-be1d-d9be73bb519a'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:36.328355 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd718dada831f485190fc62be598ae568', 'request_id': 'req-68b31753-a4a0-4b8a-be1d-d9be73bb519a'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:36.335393 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd718dada831f485190fc62be598ae568', 'request_id': 'req-68b31753-a4a0-4b8a-be1d-d9be73bb519a'} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:36.350053 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] The token cache is being invalidate because project d718dada831f485190fc62be598ae568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:22:36.350341 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:36.351001 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG keystone.notifications [None req-68b31753-a4a0-4b8a-be1d-d9be73bb519a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:22:36.352623 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: [pid: 88522|app: 0|req: 627/1263] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Aug 25 03:22:36 2022] DELETE /identity/v3/projects/d718dada831f485190fc62be598ae568 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:22:45.911175 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:DELETE=19,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:46.346048 dv-osbrick-854281-2-ceph devstack@keystone.service[88522]: DEBUG dbcounter [-] [88522] Writing DB stats keystone:SELECT=64,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:31.076023 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Authenticating user token {{(pid=88521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:26:31.077418 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:26:31.153867 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee785-d05f-4138-8baf-c7fc67056095 admin admin] Validating token access rules against request {{(pid=88521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:26:31.212349 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '896d8a3a5f9a45439eaf17c173e6c202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5d18c854b84c7fa25282ca164abd80', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:26:31.212951 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] REQUEST_METHOD: `GET` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:26:31.213256 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] SCRIPT_NAME: `/identity` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:26:31.213527 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:26:31.215228 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.fernet_utils [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:26:31.226006 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:26:31.227572 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959cbb1-86a5-4105-ace5-ac672d63cc69 service placement] RBAC: Authorization granted {{(pid=88521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:26:31.237391 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: [pid: 88521|app: 0|req: 637/1264] 10.222.0.78 () {60 vars in 1365 bytes} [Thu Aug 25 03:26:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:26:41.233210 dv-osbrick-854281-2-ceph devstack@keystone.service[88521]: DEBUG dbcounter [-] [88521] Writing DB stats keystone:SELECT=62 {{(pid=88521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}